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Analog Computer Applications in Predictor Design* 


aire. oy lade 


Summary—The theory of least mean-squared-error filtering 
and prediction of statistical time series, developed by Kolmogorov,! 
- Wiener,? Bode and Shannon,' and others,‘ has recently found appli- 
_ cations in a variety of control systems. 

: The design of optimum (least mean squared-error) predictors is 
~ based on measurement or calculation of power spectra. The present 
_ paper describes equipment for measuring power spectra at very low 
_ frequencies. It is shown that analog circuits having the transfer func- 
tions of exact stagger-tuned triples, with flat response in the pass 
band and good skirt selectivity, are easily designed and utilized in 
- conjunction with magnetic tape recordings. 
Although the optimum predictor transfer function can be com- 
puted directly from the power spectrum of the signal to be predicted, 
_ the computation is complicated and a checking procedure is desirable. 
_ An analog computation which permits such a check is described. 
; Since the power spectrum defines the optimum predictor, it deter- 
_ mines the mean-squared prediction error as well. However, if a non- 
optimum network is arbitrarily selected for use as a predictor, it be- 
_ comes desirable to determine the incremental error that results from 
use of this network. A simple analog computation which determines 
_ the error of the optimum predictor and the incremental error of a 
-nonoptimum predictor is described. This analog technique is a 
specific adaptation to prediction of the impulsive response techniques 
of Bennett® and Laning and Battin.®’ 
The ultimate test of a predictor, the comparison of its observed 
error and its theoretical error, gives an indirect check on the predictor 
_ design and can again be performed on analog computers. 


INTRODUCTION 


: ONSIDERABLE interest has been displayed in 
( the optimum prediction problem ever since the 
publication of the pioneering work of Kolmo- 
_gorov! in Russia and Wiener? in the United States. 
While the theoretical aspects of this work have been de- 
scribed quite thoroughly, little has been written about 
practical procedures in the design and testing of predic- 
tion networks. The prediction problem of interest here 

- concerns the selection of a device to estimate the instan- 
: taneous magnitude of a signal at a time a seconds in the 


* Manuscript received by the PGEC, May 1, 1956. This research 
was supported by the U.S. Navy. 
+ Bell Aircraft Corp., Buffalo, N. Y. 
1A.N. Kolmogorov, “Interpolirovanie i ekstrapolirovanie sta- 
cionarnykh sluéajnykh posledovatel’nostej,” Izvest. Akad. Nauk 
SSSR, Ser. Matematicheskaia, vol. 5, pp. 3-14; 1941. 
2N. Wiener, “Extrapolation, Interpolation, and Smoothing of 
Stationary Time Series,” John Wiley and Sons, Inc., New York, 
Y.; 1949. 
3H. W. Bode and C. E. Shannon, “A simplified derivation of 
linear least square smoothing and prediction theory,” Proc. IRE, 
vol. 38, pp. 417-425; February, 1950. 
, 4N. Levinson, “A heuristic exposition of Wiener’s mathematical 
theory of prediction and filtering,” J. Math. and Phys., vol. XXVI, 
pp. 110-119; July, 1947. 
5 R. R. Bennett, “Analog computing applied to noise studies,” 
Proc. IRE, vol. 41, pp. 1509-1513; October, 1953. 
6 J, H. Laning, Jr., and R. H. Battin, “An application of analog 
computers to problems of statistical analysis,” Cyclone Symp. II, 
Reeves Instrument Corp., p. 79; 1952. Also IRE Trans., Vol. CT-2, 
p. 44; March, 1955. : ; 
7J, H. Laning, Jr., and R. H. Battin, “Random Processes in 
Automatic Control,” McGraw-Hill Book Co., Inc., New York, N. Y.; 
— 1956. 
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future from a linear operation on the past of the signal. 
The device is chosen to minimize the mean-squared error 
between the actual value of the signal at a time ¢+-a and 
the value predicted for that instant. (We are not con- 
cerned here with a forecasting process which involves an 
estimate of the future statistical behavior of a signal.) 
The input signal is assumed to be random rather than 
an analytically specified signal such as a periodic signal, 
a polynomial, or a damped sine wave. The fact that the 
signal is not analytically defined does not preclude an 
estimation of its future if certain statistical parameters 
are specified. It can be shown that the optimum time- 
invariant linear predictor (yielding the smallest mean- 
squared error) is completely determined by the fre- 
quency content of the signal expressed as a power spec- 
trum, or indirectly as a correlation function. Filter tech- 
niques for measuring power spectra directly will be pre- 
sented. 

As might be expected, a signal is most predictable if 
its power spectrum is most sharply concentrated. This 
point is illustrated in the Appendix, where the mean- 
squared error of prediction is plotted against prediction 
interval for a family of band-pass power spectra with 
varying Q’s. 

This calculation of the mean-squared error, that will 
result when the optimum predictor is used to estimate 
the future value of a signal with a given spectrum, was 
performed on an analog computer. The technique is 
similar to the impulsive response technique described 
by Bennett® and Laning and Battin®’ for calculating 
the mean-squared output of a network excited by filtered 
random noise. 

In aclass of problems that have been of especial inter- 
est, the power spectra may be characterized by a group 
of parameters such as central frequency, half-power 
bandwidth, dc level, and high-frequency cutoff rate. In 
one case, short-term power spectra were measured over 
periods of one-half hour to six hours and it was observed 
that these spectra slowly changed with time. It was 
thought desirable to design a predictor corresponding to 
some average values of the spectral parameters, and then 
determine the incremental error that results from using 
the designed predictor for perturbed power spectra. For 
the power spectra considered, it was determined that the 
central frequency was the most critical parameter in 
designing a predictor to approximate the behavior of 
the signal about half a period in advance. This even- 
tually led to the design of a time-varying predictor 
which measures the zero crossings of a signal and adjusts 
a transfer function to respond to the measured central 
frequency. 
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The analog technique that was used to calculate the 
incremental error resulting from use of a nonoptimum 
predictor will be explained. A’ theoretical justification 
of this technique will be presented, and some specific 
calculations will be shown. It should be noted that the 
present paper is confined to the problem of pure predic- 
tion (in the absence of noise). Similar techniques can be 
applied to the problem of filtering or combined predic- 
tion and filtering, but space and time limitations pre- 
vent significant discussion of these techniques in the pres- 
ent paper. 


POWER SPECTRAL MEASUREMENT 

General 

Application of Wiener’s technique to the prediction of 
a particular random signal requires an accurate deter- 
mination of the power aki of that signal. Most of 
the previously published work (e.g., Cohen’) obtains 
the power spectrum indirectly as the Fourier transform 
of the autocorrelation function. An adequate measure- 
ment of the power spectrum of a given signal may also 
be obtained through the use of appropriate band-pass 
filters. An explanation of this direct technique of power 
spectral measurement is presented. The technique is il- 
lustrated by its application to the measurement of the 
spectrum of the previously mentioned half-hour mag- 
netic tape record. 


Data Sources 


The signals of interest here, such as airplane oscilla- 
tions, gusts, sea motion, and ship motion, are very low- 
frequency phenomena. They are most conveniently 
handled on an analog computer if they are available in 
the form of slowly varying dc signals. This may be 
achieved by fm recording of the measured data on mag- 
netic tapes. Simultaneous recording of several signals 
is achieved by modulating a series of subcarriers, mixing 
and recording on magnetic tapes. Available subcarrier 
frequencies include 1.3, 1.7, 2.3, 3.0, 3.9 kc, etc., up to 
40 kc. When the signal is required, the tape is played 
back and the information is extracted by a combination 
of band-pass filters and discriminators. Ampex now 
markets an fm recording package that is capable of re- 
cording up to six hours of 14-channel data on a 103-inch 
reel of tape. 

For illustrative purposes, a half-hour magnetic tape 
record of a random low-frequency phenomenon was se- 
cured. 

These data were recorded using older Ampex equip- 
ment and a 3.9-kce subcarrier oscillator. A portion of 
the demodulated signal was recorded on a Sanborn 
recorder and is shown in Fig. 1. All techniques discussed 
in the present paper will be illustrated by their applica- 
tion to these recorded data. 


§ R. Cohen, “Some Analytical and Practical Aspects of Wiener’s 
Theory of Prediction,” M.I.T. Res. Lab. Electronics Rep. No. 69; 
1948. 
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Fig. 1—Sample of a random input signal. 


Theory 


The power spectrum of a random signal, f(t), may be 
defined® by 


2 


“fede (1) 


®;(w) = lim ; aaa 


70 erly te 


It is readily shown that the power spectrum, ®,(w), of 
the output of a linear network when excited by a ran- 
dom input, f(¢), may be written as 


&,(w) = | &2(w) | B(), (2) 


where ®;(w) is the power spectrum of the input signal 
and k(w) is the frequency domain transfer function of 
the network. See, for example, Bennett.® In addition, the 
mean-squared magnitude of a signal is related to the 
power spectrum of the Sey by 


FO = tim — f pea = 5 [ aordo. 8) 


M>0 2 Iv 

These properties of the power spectrum justify the 
use of the mean-squared output of a narrow band-pass 
filter as a measure of the magnitude of the power 
spectrum over the pass band of the filter. If a random 
signal f(t), having a power spectrum ®;(w), is supplied 
as an input to a sufficiently narrow band-pass filter then 
the filter output has a spectrum whose power is largely 
confined to the pass band of the filter (Fig. 2). The mean- 
squared filter output is proportional to the shaded area 
under the curve (Fig. 2) and is, therefore, a measure of 
the average spectral content of f(t) over the pass band 
of the filter. Ideally, the filter should have constant 
(unit) gain at all frequencies within the pass band, and 
zero gain (infinite attenuation) elsewhere. Such behavior 
is not physically realizable, but it is possible to approxi- 
mate this behavior to any desired accuracy. 

An indication of the performance of physically real- 
izable filters is presented in Fig. 3, where the squared 
gain of three band-pass filters is compared. These filters 
are identified as a simple band-pass filter, whose squared 
gain is given by 

2 2-2 
| k%)| = ie » 
(1 — w?/ewo2)? + w?/w2Q? 


a cascaded identical m-tuple, whose squared gain is 


2 a w/a O24 ad) is 
| a?) | = E = w?/w97)* + w?/a0?Q?(2U* —-1) | “ 


and an exact staggered n-tuple, whose squared gain is 


°S. O. Rice, “Mathematical analysis of random noise,” Bell Sys. 
Tech. J., vol. 23, pp. 282-332; July, 1944. Also vol. 24, pp. 46-157; 
January, 1945. 
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Nn 
FILTER RE SPONSE 


POWER SPECTRUM 


Fig. 2—Filter input-output comparison (frequency domain). 
Note: The output of a power spectral filter is mostly confined to the 
pass band of the filter. With poor choice of filter characteristics, how- 
ever, off-band peaks may cause error (A above). 
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Fig. 3—Gains of various band-pass filters. 
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Magnitudes of 2=3 and Q=10 were considered. In 
each case, Q represents the ratio of central frequency, 
wo, to half-power bandwidth. All plots were made 
against a nondimensional frequency, w/wo. 

It will be noted that the exact stagger-tuned filter has 
the flattest characteristic within the pass band as well 
as the sharpest rejection outside this pass band. These 
are both desirable characteristics in a filter. While such 
stagger-tuned filters have been used in radar work, this 
is believed to be a new application to frequencies below 
1 cps. 

A quantitative measure of performance may be ob- 
tained by comparing the filter response to each of a pair 
of specified signals. The first signal has its entire fre- 
quency content confined to the half-power bandwidth 
of the filter, and is flat over this frequency band. The 
second signal has a completely flat spectrum. The ratio 
of the mean-squared filter output resulting from the first 
signal to the mean-squared filter output resulting from 
the second indicates the efficacy of the filter in rejecting 


Bates, Bock, and Powell: Analog Computer Applications in Predictor Design 


145 


the undesired portion of a signal. This ratio is unity for 
an ideal filter. It has been calculated for a simple band- 
pass filter, a cascaded identical triplet, and an exact 
staggered triplet, with results of 0.500, 0.694, and 0.863, 
respectively. In the case of an exact staggered n-tuple, 
this ratio is given by 


1 1 qr (ni2l (2k — 1) 
R(m) = — + — sin COS Searetten = 
2, T Qn ja 2n 
mr(2k — 1 
[ 1+ cos ( ) 
] Z (7) 
n 
(2k — 1) 
1 — cos — —— 
2n 


which increases monotonically to unity as m increases. 

Selection of an adequate filter must depend on some 
prior knowledge of the power spectrum of the signal to 
be measured. Thus, the Q of the filter should be large 
compared to the Q of the power spectrum of the signal. 
Similarly, signal rejection outside the pass band should 
be sufficient to yield a filter output that peaks at the 
natural frequency of the filter, and does not have sig- 
nificant components at the dominant frequency of the 
input signal. This rejection may be secured by choice 
of sufficiently large Q, and selection of exact stagger 
tuning with an adequately large n, although the size of 
these quantities is limited by the length of the available 
data sample. The choice of filter parameters should be 
validated by appropriate monitoring of the filter out- 
puts. Thus, the central frequency of the filter output 
should fall within the pass band, and the ring-out time 
should not be excessive. 


Analog Technique 


A simple analog circuit for an exact staggered triplet 
is shown in Fig. 4. It will be noticed that this triple stag- 
ger-tuned filter requires nine amplifiers (although 
twelve are utilized to simplify pot setting). In addition, 
a squaring device and a low-pass filter (for averaging) 
are required. Determination of a power spectrum re- 
quires repeated runs with the same data or use of a 
large number of analog computers. 

The analog technique for measuring power spectra 
was employed to determine the power spectrum of the 
previously mentioned signal. The 3.9-kc tape recorder 
output was demodulated and supplied as an input to the 
analog circuit shown in Fig. 4. A Q of 10 was selected, 
and the mean-squared filter output was evaluated at 
each of ten different frequencies. A comparison of the 
filter output and the square of the filter output with the 
filter input, when the filter is tuned to a central fre- 
quency of 0.660 radians per second, is presented in Fig. 
5. For the filters discussed here, the response to a unit 
white noise has a mean-squared value which is equal to 
wo/Q times a constant that depends solely on the form of 
the filter. For the exact staggered triple, this constant is 
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Fig. 4—Power spectral analyzer. 
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Thus, the mean-squared value of the filter output must 
be divided by 0.90377 wo/Q before being interpreted as a 
point of the power spectrum. The measured points of 
the power spectrum are plotted in Fig. 6. 

As indicated earlier, this analog technique of spectral 
measurement requires repeated runs at different filter 
frequencies with the same input data supplied to the 
filters. This obviously requires a large expenditure of 
time or use of a large quantity of equipment. 


Simplified Spectral Analyzer Equipment 


In order to speed the measurement, it has proven 
necessary to design special band-pass filters, employing 
modified dc amplifiers. The amplifier uses a dual triode 
on the input with cathode coupling to provide subtrac- 
tion. The two grids are then available for positive and 
negative feedback, respectively. Many commercially 
available dc amplifiers may be modified for the present 
purpose by disconnecting the chopper stabilizer. The 
remainder of the circuit is provided for amplification, 
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Fig. 5—Exact staggered triple filter input-output comparison. 
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except that a cathode follower is added for isolation be- 
tween the constituent band-pass filters. 

The desired filter characteristic is secured by employ- 
ing resistive negative feedback together with a Wien 
bridge in the positive feedback circuit (see Fig. 7). It 
may be shown that the transfer function of the circuit 
is given by 


F (eo) = k'jw 
epee ect Pay? a jwon/O - 
where 
ot = (9) 
CiC2Ri(Re + R3) 
and 
afieneed) 
A Ry C2 - Ra Re 
wo Ret Rs C1 B(Ry + Rs) 
Ops Gas 


It is convenient to set 1/C2:Ri=wo and Co=Ci, Ro+ 
R3= Ri, whereupon 


1 1 
R3). 1 + Ry {| — + — 
1 | ie ie I il 


— = 3 — ——__________ (10) 
Q R(R2 + Rs) 


As a result, a triple staggered-tuned filter may be ob- 
tained through use of only three modified dc amplifiers 
and three cathode followers instead of the nine to 
twelve dc amplifiers required for synthesizing the filter 
on an analog computer. 


Other Techniques 


An alternate procedure for obtaining power spectral 
measurements involves the recording of data on mag- 
netic tape at slow speed and playing back at signifi- 
cantly faster speeds (Pierson, Jr.'°). Such a technique 
has the advantage of speeding the data reduction 
process and of raising frequencies to a point where 
standard equipment is available for performing the fil- 
tering. The only disadvantage of this technique is the 
introduction of noise during the process of recording 
and speeding up the data. 


PREDICTION THEORY 


The error that results from predicting a random signal 
f(t) by means of an arbitrary linear time-invariant net- 
work with an impulsive response K,(t) is derived as fol- 
lows. The normalized mean-squared error of predicting 
a seconds ahead is given by 


10 W. J. Pierson, Jr., “An Electronic Wave Spectrum Analyzer 
and Its Use in Engineering Problems,” Beach Erosion Board, Corps of 
Eng., U.S. Army Tech. Memo. No. 56; October, 1954. 
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If the transfer function of the prediction network is de- 
fined by 


Raw) = [ Keertrdr 


0 


(12) 


and if the Fourier transform of the truncated signal 


i tT) Mae aie oe 
eg i 0, elsewhere oe 
is given by 
Fr(w) = “Hed, (14) 


then by the Parseval relationship, the normalized mean- 
squared error becomes 


| Fr(w)e@* — F p(w) Ra(w) [2d 


limes 
T © eS 
E,(a) = 1 x ' (15) 
dalle Cab 
But? the power spectrum of f(t) is given by 
PF 2 
6(w) = lim | Fo() | (16) 
TT 0 
which reduces the error expression to 
fF B(w) | e#* — ka(w) |2dw 
E,(a) = —— (17) 


[seas 


—2 
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It will be assumed that ®(w) is a rational function in 
w*, and it is then convenient to introduce a factorization 
of the nonnegative, “even” function 


P(w) = V(w)¥*(w) (18) 


such that all zeros and poles of V(w) lie in the upper half 
plane, and all zeros and poles of Y*(w) are complex con- 
jugates of the poles and zeros of Y(w) and lie in the lower 
half plane (see Wiener? and Levinson’). The error ex- 
pression, (17), may then be rewritten as 


[> | were — ba(e)] de 


[| ¥@ [Pe 


—eo 


Now y(t), the impulsive response function or weighting 
function corresponding to the transfer function V(w), 
may be obtained from 


1 2 re 
y(t) = = J Ywe du. (20) 


It is readily shown that W(t) vanishes for negative ¢t; 
since V(w) is free of poles in the lower half plane. Thus, 
by a second application of the Parseval relationship, 
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J [ve+ ae [ vu a e)Ka(o)dr | 
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may be reduced to zero, yielding Wiener’s optimum pre- 
dictor formula 


1 © co 
ka(w) = ait V(t + a)e~'dt. (23) 


The first fraction is therefore the inherent least mean- 
squared predictor error. However, if a nonoptimum 
weighting function, K,(7),is selected, the second fraction 
indicates the incremental error that results from this 
nonoptimum selection. 


VERIFICATION OF THE PREDICTOR DESIGN 


The formulas that characterize the transfer function 
of the predictor require an analytic approximation to 
the power spectral measurement. This approximation is 
most conveniently performed after the measured data 
have been plotted on log-log paper. By definition, power 
spectra are nonnegative even functions of the fre- 
quency w. It is most useful to approximate the power 
spectrum by a rational function of w?, and it is necessary 
to assume that there are no real poles (corresponding to 
purely periodic components) nor real zeros (corre- 
sponding to frequencies that are absent). In addition, 
the highest power of w? in the denominator should ex- 
ceed the highest power of w? in the numerator. Approxi- 
mation of the power spectrum by a rational function 


E,(a) = = (21) utilizes techniques that are frequently employed in 
i y(t) dt servomechanism problems. Accuracy of the approxima- 
0 tions is limited only by the permissible complexity of 
; , : é the analytic approximation. 
which may be rewritten as In the present example, the measured power spec- 
ve Laer trum (Fig. 6) was approximated by the expression: 
re a 
Pia) = — ae (0.197w)4 
ioe) (és) — 
{ P(Odt (w® — 0.37905)4 + (0.197w)4 
0 
2 eo 2 0.00379 oa 
— — 7)K,(r)dr | d y 
f | v4 + a) i) ¥(t — r)K.(7) | t w? + 0.37905 (24) 
i - 22) te Wee, 
(1) di see Fig. 8). 
f Y(t) It is not difficult to obtain 
os 0.0195(—w? + 0.820jw + 1.611)(—w? + 0.520jw + 0.089) ee: 
(6>) = 


(jo + 0.616)(—w? + 0.12370 + 0.302)(—w? + 0.155jw + 0.476) 


It will be noted that the two error components in (22) 
are each nonnegative. The first fraction is completely 
specified by the power spectrum. The second fraction 


k;(w) = 


1.259(jo)4 + 2.787( jw)? + 2.553( jo)? + 1.395ju + 0.350 


from this power spectrum. Direct application of Wie- 
ner’s formula, (23), yields the transfer function k5(w) 
for an optimum five-second predictor, where 


(jo)4 + 1.340(jo)* + 2.127(jo)? + 0.91070 + 0.144 


(26) 
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Fig. 8—Power spectrum, analytic approximation. 


The selected predictor transfer function may be veri- 
fied by comparing ~(t+a) with the convolution integral 
Jow(t—1)K.(r)dr [see (22)]. This check may be per- 
formed in the following manner. Wire a network with a 
transfer function V(w) on the analog computer (Fig. 9) 
and apply an impulse or appropriate initial condition to 
this network to obtain W(t). Supply W(t) to a second ana- 
log computer network corresponding to the predictor 
(Fig. 10). The resulting predictor response should be an 
exact a-second extrapolation of w(t). This check was per- 
formed for the five-second predictor (26) corresponding 
to the power spectral approximation of (24). The com- 
parison of W(t), W(¢+5), and the predictor response to 
y(t) is shown in Fig. 11, next page. It should be noted 
that this technique may also be justified by using the 
point of view developed by Bode and Shannon.’ 


CALCULATION OF INHERENT MEAN-SQUARED ERROR 


The normalized mean-squared error associated with 
the optimum linear a-second predictor of (22) may be 
written as 


(27) 
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Fig. 9—Circuit for theoretical error. 
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Fig. 10—Wiener predictor network. 
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PREDICTION 
ERROR 


where y(t) is the impulsive response of V(w), as defined 
earlier. It is assumed that no purely periodic compo- 
nents are present; y(t) decays to zeroand therefore, the 
asymptotic value of £,,(q@) is unity, corresponding to 100 
per cent error. It should be noted that this process is, 
in a sense, a trivial case of the adjoint method described 
by Laning and Battin.®.?7 However, since the present 


IMPULSIVE RESPONSE Y(t) 


RELATIVE AMPLITUDE 


TIME (SECONDS) 


Fig. 11—Check of predictor network. 


paper deals with time-invariant systems, it is possible to 
justify the method without employing the powerful 
tools of the adjoint technique. The impulse response 
method described here can be readily understood on its 
own merits, as a direct consequence of (22). 

Application of this formula for analog computation 
of the mean-squared error presents no difficulties. The 
impulsive response, ¥(t), may be generated by imposing 
an appropriate initial condition on the network whose 
transfer function is V(w), Fig. 9. The mean-squared 
error, E(a), is obtained by squaring and integrating the 
output, ¥(t). The asymptotic value of the integrated 
squared output corresponds to 100 per cent mean 
squared error. Traces of W(t), (4), and /$w2(é)dt for the 
previously mentioned input signal are shown in Fig. 12. 
It will be noted that the mean-squared prediction error, 
while monotonically increasing, does not increase uni- 
formly. This results from the fact that the power spectra 
considered here have relatively sharp peaks. As a result, 
the transfer functions, ¥(w), correspond to band-pass 
filters, and impulsive responses, W(t), appear in the form 
of decaying oscillations. The squaring process doubles 
the apparent frequency and accentuates the zero cross- 
ings. Therefore, the error function E(a), corresponding 
to the integral of ¥?(¢), grows in a stepwise manner. Thus, 
in the present example, the error to be expected from 
predicting 13 seconds ahead is considerably larger than 
the anticipated error that will result from predicting 11 
seconds ahead, whereas the error to be expected in pre- 
dicting 15 seconds ahead is hardly larger than the error 
that will result from predicting 13 seconds ahead. 


CALCULATION OF THE INCREMENTAL ERROR 


In order to calculate the incremental error that re- 
sults from using a nonoptimum predictor, it is again 
necessary to obtain the impulsive response w(t). This 
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Fig. 12—Theoretical mean-squared prediction error. 


response may be generated by placing an appropriate 
initial condition on the network whose transfer function 
is W(w) (see Fig. 9). Similarly, the convolution integral 
/oW(t—7r)K.(r)dr may be obtained as the output of the 
predictor [whose transfer function is ka(w)] when excited 
by W(t). If w(t) and W(t+a) are generated simultane- 
ously, the inherent error for a particular prediction in- 
terval, and the incremental error 


if “|v hg fi RE )Ka(oydr | at 
f “Pod 


resulting from use of a nonoptimum predictor may be 
readily calculated on an analog computer through the 
use of subtracting, squaring, and integrating circuits. 
Simultaneous generation of ~(t) and ~(¢+qa) is readily 
achieved by wiring identical networks V(w) on each of 
two computers, applying the same initial conditions, 
and employing a relay to turn one machine on exactly a 
seconds after the other machine goes on. 

A specific power spectrum of the form 


c7ws + Bw4 + A? 
&(e) = ———___—. 
(w? ae «9”)4 + 64a)4 
0.379108 + 1.218804 + 0.0206 


~~ (@? — 0.3791)4 + 0.001506! 


(28) 


was used for selecting the predictor, and the incremental 
error was determined for three groups of perturbed 
power spectra. In the first perturbation, w was replaced 
by w/(1+e), and € was varied from +0.2 to —0.2. In the 
second perturbation, 6 was varied between 0.1 and 0.6 
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Fig. 13—Error increment from wrong central frequency assumption. 


(design bandwidth =0.197). In the third perturbation, 
A? was maintained equal to C?w 9°, but the ratio A?/B? 
(arbitrarily called the dc level) was varied from 0.00001 
to 0.005 (design value=0.001). In Fig. 13, Fig. 14, and 
Fig. 15, next page, the inherent error corresponding to 
each of these assumed power spectra is compared with the 
total error by utilizing the preselected predictor. The in- 
herent errors varied considerably, but the incremental 
errors were significant only when the central frequency 
changed by more than 5 to 10 per cent when the half- 
power bandwidth exceeded the design value by more 
than 30 to 50 per cent, or when the low and high- 
frequency power varied excessively. 

In view of these results, it appears that an accurate 
central frequency measurement is essential, and that 
rough (average) estimates of half-power bandwidth, dc 
signal content, and high-frequency cutoff may be ade- 
quate. An investigation of the effects of small discrepan- 
cies in the magnitudes of selected passive elements of 
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Fig. 14—Error increment from wrong bandwidth assumption. 


the predictor may be performed in a similar manner. 

By using a servo to set a series of ganged pots to the 
measured central frequency wo, it has been proven pos- 
sible to design a time varying predictor that adjusts it- 
self to slow variations in the power spectrum of the sig- 
nal to be predicted. The device has been tested in the 
laboratory and also in the field with some success. 

Similar error-calculating techniques may be applied 
to predicting a signal with power spectrum ®,(w) in the 
presence of additive noise with power spectrum ®,(w). 
The normalized mean-squared error may be written as 


E,(a) = 


f =p ee — BA (c) [26,(w) + | kaw) |2?®n(w) |do 


(eon 


—o 


- (29) 


Application of the Parseval relationship yields 


"Wall + a)dt + [Wee + a) — Kaew Pat + f *[Kald) « vat) at 


(30) 


E,(a) = 


if “yet(ddl 
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Fig. 15—Error increment from wrong assumption or dc level. 


where the convolution operation /fW(t—r)K.(r)dr is 
designated by K,(t)*(t). This error term can also be 
calculated on an analog computer, using the impulsive 
response techniques mentioned earlier. 


FINAL CHECK 


The ultimate check on the accuracy of the predictor 
is obtained by an actual prediction of the recorded sig- 
nal. The recorded signal is supplied as an input to the 
predictor, and the predictor output is stored or delayed 
for a time corresponding to the prediction interval, a, 
and is compared with the input signal @ seconds in the 
future. 

An exact measurement of the prediction error may 
thus be obtained by utilizing a delay line. The magnetic 
tape passes over two readout heads that are separated 
by a distance that corresponds to a seconds at the 
appropriate tape speed. The head furthest from the take- 
up reel supplies advance information for comparison 
with the predictor output. The instantaneous prediction 
error may be obtained by means of an appropriate dif- 
ferencing circuit. This error is shown together with the 
input and output of the predictor and an exact a-second 
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Fig. 16—Predictor performance. 


extrapolation of the predictor input (Fig. 16). Finally, 
the mean-squared prediction error may be measured by 
conventional analog computer techniques and com- 
pared with the theoretically determined mean-squared 
error for the optimum predictor. In this case, the meas- 
ured mean-squared error was about 11.5 per cent where- 
as the theoretically calculated mean-squared error was 
about 11 per cent which seems to indicate excellent 
agreement. 

Once the various checks have been run, the predictor 
is available for use in the form of a circuit on the analog 
computer. A network is then available for predicting any 
signal that has the measured power spectrum. Thus, if 
the data are statistically stationary, samples thereof 
may be analyzed, and the corresponding predictor net- 
work may be designed and utilized to predict other sam- 
ples of the same data. If it is desirable, some de ampli- 
fiers may be saved at the expense of additional network 
complexity. 


APPENDIX 
ADDITIONAL RESULTS OF ERROR COMPUTATIONS 


The analog computation of mean-squared error may 
also be utilized to indicate the theoretical dependence 
of mean-squared error on such power spectral param- 
eters as central frequency, half-power bandwidth, low- 
frequency content, and high-frequency cutoff. The 
dependence of predictor error on central frequency and 
half-power bandwidth is illustrated by considering the 
family of band-pass spectra 


w?/wo?Q0? 
(1 = ot/avt? + o8/oot? 
discussed by Lee and Stutt.!! These spectra are shown in 


Fig. 17 and are characterized by central frequency wo 
and ratio of central frequency to half-power bandwidth, 


P(w) = (31) 


ity. W. Lee and C. A. Stutt, “Statistical Prediction of Noise,” 
M.1.T. Res. Lab. Electronics Rep. No. 129; 1949. 
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Fig. 18—Mean-squared error for band-pass power spectra. 


Q. The power spectra are functions of w/w», and conse- 
quently, the mean-squared error is a function of wot. A 
plot of mean-squared error for Q equal to 10, 20, 40, 
and 90 is shown as Fig. 18. 

The dependence of prediction error on de content and 
high-frequency cutoff rate is illustrated by considera- 
tion of the family of power spectra 


k?(wo8 — «)®w9) -- (64 — 2kwW94)a4 
(w? —s wo")4 _ 64w4 


P(k, w) = (32) 
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Fig. 19—Family of power spectral approximations. 
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Fig. 20—Mean-squared error for various spectral approximations. 


where fixed values of 6? and w»” were used. The ratio of 
dc power to peak power is approximately k? (Fig. 19). 
Corresponding mean-squared error traces were obtained 
on the analog computer and are shown in Fig. 20. 

The relationship between prediction accuracy and 
power spectral parameters corresponds in its general 
nature to the results that would be anticipated from 
physical reasoning. Thus, in dimensionless time, of, 
accuracy of prediction is strongly dependent on the 
sharpness of the spectrum, improving rapidly with in- 
creasing Q, decreasing low-frequency signal content, 
and sharper high-frequency cutoff. The numerical re- 
sults presented in Figs. 18 and 20 indicate the precise 
nature of this dependence. Similar computations may 
be necessary to determine corresponding results for 
other spectra of specific interest. 
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The Theory of Nets* 


F. E. HOHN}, S. SESHUt, anp D. D. AUFENKAMP$ 


Summary—tThis paper presents the general concept of a weighted 
directed graph which we call a net. Illustrative examples leading up to 
the definition of a net indicate its applicability to a wide variety of 
problems in communication and network theory. A number of 
theorems concerning the proper paths of anet are established. A non- 
arithmetic matrix calculus is developed to facilitate computations and 
formalize proofs. In later papers, the techniques presented here will 
be exploited in the study of the theory of sequential machines. 


I. ILLUSTRATIVE EXAMPLES 
A. The Connection Relation of a Finite Linear Graph 


HE origin of one theory of sequential machines is 

ultimately in the theory of finite, nondirected, 

linear graphs which, in accordance with custom, 
we simply refer to as linear graphs in the following dis- 
cussion. Geometrically, such a graph is a finite set of 
nodes—points in 3-space—and a finite set of branches 
connecting certain of these nodes and having no other 
points in common than the nodes. Branches proceeding 
from a node back to the same node are customarily ex- 
cluded from consideration, but in the generalizations to 
be developed in later sections, they are often useful so 
we choose to admit them. The fundamental relation be- 
tween node and branch is that of incidence. The informa- 
tion regarding incidence is summarized in what is called 
an incidence matrix in which there is one row for each 
node and one column for each branch. Suppose the 
nodes are numbered 1, 2, --+, 2 and the branches 1, 
2,--+-, m. The elements of the incidence matrix AH, 
are then defined as follows: 


1 if nodez and branch / are incident, 


H = hs; nzmy hi; = 
‘ | zl : ‘. otherwise. 


From this incidence matrix one derives many of the 
essential properties of linear graphs [1, 2]. 
In the matrix product, 


Ry = Us pe bee 


formed in the usual way, we have as the entry in the 
ith row and the jth column 


m 
ri = 2, buclin. 
k=1 


The term hjh;, of this sum will be 1 if and only if hy, = 
hj, =1; that is, if and only if nodes 7 and j are both on 
branch k. If «47, hij, is thus 1 if and only if nodes 7 
and j are connected by branch k. Thus if ordinary arith- 
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metic is employed, 7;; is equal to the number of branches 
connecting 7 and j, when 7#j. On the other hand, when 
7 =], 7;; is equal to the number of branches incident with 
node 7. Thus if there are no branches from node to itself, 
ri; >O0 if and only if node7is not isolated from the others. 

If we interpret “+” as the Boolean “or” so that 
0+0=0, 0+1=1+0=1+4+1=1,0-0=0-1=1-0=0,1-1 
= 1, in evaluating the entries of Ri, we have 


1 if there exists at least one branch 


connecting nodes i and j wheni ¥ 7; 
ri = Faure : ; ; 
: 1 if 7 is not isolated or has a loop, when i = 4, 


0 otherwise. 


The matrix R; is then the “relation matrix” for the re- 
lation of connectedness of the nodes of the graph. Since 
in a nondirected graph the connection relation is sym- 
metric, R, will also be symmetric. We call R; briefly the 
connection matrix of the graph. 


B. Binary Relations on a Finite Set 


The connection matrix of a finite linear graph sug- 
gests a method of representing any binary relation on a 
finite set. A binary relation on a finite set S of order 1 
is defined to be a subset of the set of all ordered pairs of 
elements of S. The pair (s;, s;) belongs to the subset; 
1.e., to the relation, if and only if s; bears the relation to 
s;. We can represent the set S as the nodes of a graph 
in which each ordered pair (s;, s;) of the relation is 
represented by a directed branch from the node corre- 
sponding to s; ¢o the node corresponding to s;. In this 
graph there is at most one directed branch from one 
node to another. We can now describe both the relation 
and the associated graph by means of a relation matrix 
R of order n: 


R= [ri rg = { 


1 if (s;, s;) belongs to the relation, 


O otherwise. 


Such relation matrices have been studied extensively 
Beale 

In essence, a relation matrix R defines all the proper- 
ties of the corresponding relation. For example, a rela- 
tion is symmetric if and only if for each pair (s;, s;) be- 
longing to it, the pair (s;, s;) also belongs to the relation. 
Thus the relation is symmetric if and only if its relation 
matrix R is symmetric. Again, a relation is reflexive if 
and only if every pair (s;, s;) belongs to the relation; 7.e., 
if and only if 7;;=1 for all 2. In the graph of a relation, 
to a pair (s;, s;) there corresponds a loop; 1.e., a branch 
proceeding from the node corresponding to s; back to 
the same node. A relation is transitive if and only if 
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whenever (s;, s;) and (sj, s,) belong to the relation, 
(si, sx) belongs to the relation also. Now we define the 
symbol “<” for “inclusion” in Boolean arithmetic to 
mean 0<0, 0<1, 1<1, and define further for two 
matrices R and P of the same order that R<P if and 
only if r;;<,; for all ¢ and 7. Then it is not hard to show 
that a relation with matrix R is transitive if and only if 
R?<R where R? is formed in the usual way but with 
Boolean arithmetic being employed. Finally, using 
Boolean arithmetic and the logical product R*S = [r,;5;; | 
for matrix multiplication, we could show that the set of 
all relation matrices of order 7 is a Boolean algebra with 
2”* elements ([4], p. 209). The purpose of these remarks 
is simply to emphasize that the properties of a relation 
may be deduced from suitable operations on its matrix R. 

The concept of a finite relation underlies much of the 
work of the papers of this sequence. 


C. Combinational Relay Circuits 


Let us next look at a combinational relay-contact 
switching circuit (for details see [5, 6]) such as is il- 
lustrated in Fig. 1, in which a, 6, c, x denote contacts. 
Here again we have an underlying graph, certain nodes 


©) 
a oo 
; 4; ama a 
ay 
4 
Fig. 1. 


of which—the terminal nodes—the network is designed 
to interconnect, and other nodes of which—the non- 
terminal nodes—merely represent binding posts in the 
circuitry. In Fig. 1, nodes 1 and 2 are terminal nodes, 
whereas nodes 3 and 4 are nonterminal. 

Now assume that exactly enough nonterminal nodes 
have been marked on the graph so that between any 
two nodes, terminal or nonterminal, there are no two 
contacts in series; 7.e., at most a single contact or con- 
tacts in parallel. All these nodes together constitute a 
finite set and the condition that certain pairs of them 
be connected when a given contact is closed is a relation 
on this set, associated with that particular contact 
symbol. That is, if there are p nodes altogether, then 
for each contact symbol x of the switching circuit, there 
exists a p Xp relation matrix 


Re = [ri] 
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such that 
(1 ift #7 andiand/ are connected when wis closed, 
1 if « =7 since in this application a node is as- 
Peg” = 


sumed to be always connected to itself, 
0 otherwise. 
(If contacts # appear, where # is the complement of x, 


then a matrix R* is associated in the same way with #.) 
For example, in the case of the circuit of Fig. 1, we have 


LypOs0s A. 

OF tau. 
Re = 

Oe a @) 

LeO nO 


Since relays are bilateral devices, these relation 
matrices are always symmetric. 

The primitive connection matrix of the circuit may now 
be defined as a weighted sum of these relation matrices. 
If x;, #;, G=1, 2, - - - , m) are the contact variables, this 
sum is defined to be 


P = Do aj;R% + DD #;R% 
j=l qa 
where the symbol “+” is the “inclusive or” operation of 
Boolean algebra. (The 7zj entry of «R* is defined to be 
xriz, if 747 and 1 if 7=7.) 
In the case of our example, we have 


l Opa 
aires OS Ae scReG 
P= a¢R*+ 6R+c¢cR6+ xR? = - 
Ge el 
L160 ‘A 


which can be determined directly from the circuit by 
inspection. 

The algebra governing the contact symbols is the 
usual Boolean algebra of switching circuits. The primi- 
tive connection matrix is in effect a wiring diagram of the 
circuit. 

A primitive connection matrix is an example of what 
is called a switching matrix, namely, a square matrix 
whose diagonal entries are all 1’s and whose off-diagonal 
entries are arbitrary switching functions. These switch- 
ing matrices may be employed effectively in both the 
analysis and the synthesis of combinational relay cir- 
cuits [6, 7]. 


Il. SEQUENTIAL MACHINES 


A. State Diagrams of Sequential Machines 


The same concept of a connection relation enters into 
the theory of sequential machines; that is, devices or cir- 
cuits which are designed to make certain sequences of 
outputs correspond to given sequences of inputs. A sim- 
ple, abstract mathematical model of such a machine has 
recently been proposed by Moore of Bell Telephone 
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Laboratories [8]. In Moore’s model, a sequential ma- 
chine is defined as consisting of 

> Sny 

-, Xp, and 
Sy Ser 


a finite number of distinct states, 51, 52, °° ° 
a finite number of distinct inputs, x1, x2, °° 
a finite number of distinct outputs, y1, ye, * ° 


all related in such a way that 1) the present output de- 
pends only on the present state and 2) the present 
state depends only on the previous state and the previ- 
ous input. That is, each input applied to the machine in 
a given state results in a uniquely defined next state 
with its uniquely defined output. This definition makes 
it clear that the present state and output depend on the 
past history of the machine. In this definition, the 
word “state” is to be regarded as an undefined term. 
Moore represents such a machine by a graph as fol- 
lows: to each state s; corresponds a node 7; to each dis- 
tinct input which drives the machine from state s; to 
state s;, there corresponds a directed branch from node 
z to node j. This graph is called a state diagram of the ma- 
chine. Such a graph may have more than one branch 
from one node to another and it may also have loops 
from a node to itself. In drawing it, we denote a node by 
a circle large enough to include a symbol identifying 
the node and a symbol identifying the output associated 
with the corresponding state. Beside each branch is 
written the symbol for the corresponding input. These 
matters are illustrated by the state diagram of a ternary 
flip-flop shown in Fig. 2. Here there are three states 1, 2, 


A 


Fig. 2. 


3, with associated outputs 0, 1, 2, respectively. The in- 
puts are A and B; an input B leaves each state invariant 
while the input A drives each state into the “next” state: 
Pinto 2, Zanto.3, and 3 into 1. 

Using the above definition and representation of se- 
quential machines, Moore derives a number of their 
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important properties. In this and succeeding papers, we 
introduce a matrix calculus which enables us to mecha- 
nize and to extend many of his results. 

The development of the matrix model here is closely 
analogous to that given for relay circuitry in the last 
section. Thus, in the case of our ternary flip-flop, we 
associate with the inputs A and B the following relation 


matrices: 
| ik OW 
=F 0) 4b 


panes 


We call these “transition matrices” because they repre- 
sent the transitions from one state to another occasioned 
by the corresponding input. Also, as before, we define a 
weighted sum of these relation matrices which we call 
the “connection matrix” C of the machine. In the case 
of our example, we have 


UM AW) 
Tei NOt Oe fe} 
1 0 +0 


Bima 
= AT4+ BT? =|0 BA 
eR REM 83 


which reveals how the states are permuted by the vari- 
ous inputs. 

In general, if the inputs of a machine with u states are 
- , Xp», We associate with each x, the transition 
matrix T* defined as follows: 


KN, 2, ~ * 


1 if input a, takes state s; 


t= | 


into state s;, 


OQ otherwise. 


The connection matrix of the machine is then defined 
as 


C= Dy, Sel *? 
fai 
In the formation of this sum, one uses the usual rule 
for multiplying a matrix by a scalar and the operation 
of addition has the meaning “or.” 

It is important to note that giving the outputs of the 
n states and either the set of transition matrices or the 
single matrix C defines the machine completely. 

In later papers of this sequence, we employ the transi- 
tion matrices as well as other appropriate matrices to 
study the analysis and synthesis of sequential machines 
in detail. In the remainder of this paper, we discuss a 
generalized type of graph of which each type of graph 
mentioned so far is a special case. 


III. Nets 
A. Definition of a Weighted, Directed Graph or Net 


The concept of a state diagram suggests the following 
generalization. We begin with a finite set of objects, 
denoted by 2, v2, - ++, Um which we call vertices and a 
finite or infinite, discrete or continuous set {w} of vertex 
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weights. From {w} we select a single element w; to be 
associated with each vertex v;. The set of pairs (v;, w;) is 
the set of weighted vertices. The w; need not all be distinct 
so when convenience requires, we denote the distinct 
elements among them by a, w2, + + + , Wp. 

We next consider a set of not necessarily distinct or- 
dered pairs of vertices (v;, v;), which are called directed 
branches. (A branch of the form (v;, 2), is called a loop.) 
Let these branches be m in number and let them be de- 
noted by dy, be, - + + , bm. Now let there be a finite or in- 
finite, discrete or continuous set {x} of branch weights 
from which we select a single element x; for each branch 
b;. Then the set of pairs (6;, x;) is the set of weighted 
branches. The x; need not all be distinct, and we denote 
the distinct elements among them by &, &,--+, &4. 

The sets of weighted vertices and weighted branches 
defined above together constitute what we call a 
weighted, directed graph or net. This abstract definition 
of a net has a simple, geometrical representation. As in 


the case of the state diagram, we represent the vertices 


as small, disjunct circles in the plane. Inside each circ 
we write the name of the vertex and of the associaggt 
weight. For each branch of the net we draw an ag 
from the initial vertex to the terminal vertex @ 
branch and write the weight of the branch beg 
An example of such a graph is shown in Fig. 3. 4 


If loops do not appear, and if all the vertex weights 
are the same and all the branch weights are the same, 
the weights may be ignored and the theory of directed 
graphs ({2], p. 4) results as a special case. If further 
with each branch (v;, v;) the graph also contains the 
branch (v;, v;), we may identify each such pair of oppo- 
sitely directed branches as a single, undirected branch 
and thus obtain the usual theory of linear graphs as a 
special case. If no loops appear, if the vertex weights are 
all equal and hence may be ignored, if the branches ap- 
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pear in equal-weighted pairs so that they may be re- 
garded as undirected, and if the branch weights are 
switching functions, we have the relay circuit example 
mentioned in Section I-C as a special case. If the vertex 
weights are node voltages and the branch weights are 
currents or impedances, we obtain ordinary network 
theory. The state diagram of a sequential machine pro- 
vides a totally different example of a net in which both 
vertex weights and branch weights are of significance. 
It is important to note that each application requires 
its own special algebra for combining the weights. In the 
relay case, it is the usual Boolean algebra of switching 
functions; in the case of ordinary network theory, it is 
the algebra of complex numbers, etc. Also, it is possible 
that in particular cases there are different aspects of the 
physical system under study which result in there being 
more than one set of branch weights (or node weights). 
In such a case we may associate more than one net with 
the problem. 
ious special nets have been applied to nonelec- 
problems. Some of these concern communication 
[9-13]; sociology and psychology [14, 15]; 
[16]; logic [17]; and others. The work of 
[9] has provided inspiration for the present 
definitions. A somewhat more restricted concept of a net 
than ours has been studied by Luce [20, 21 ]. 


B. The Fundamental Matrices of a Net 


In the theory of directed graphs as developed by 
Veblen [1] and Kénig [2], no loops are admitted and 
an incidence matrix A is employed which is a generaliza- 
tion of that defined in Section I-A. If there are 1 vertices 
and m branches, A = [ai;]_ is defined as follows: 


nom 

a;;=1if branch j has vertex 7 as an initial point. 
ai;=—1 if branch 7 has vertex 7 as a terminal point. 
ai;=0 if branch jdoes not have vertexzasanend point. 


In the applications it is at times necessary to admit 
loops. In this case certain entries of A would have to be 
both 1 and —1 so that the above definition of the inci- 
dence matrix would no longer be meaningful. Hence 
we shall define two other matrices, A+ and A-~, related 
to the incidence matrix, which are appropriate for the 
study of the more general case. 

The matrix An z»+ is defined thus: 


ai;+=1 if branch 7 has vertex z for an znztzal point. 
ai;+ =0 otherwise. 


The matrix Anzrm is defined thus: 


a;; =1 if branch 7 has vertex 7 for a terminal point. 
a;; =0 otherwise. 


In case the graph contains no loops, the incidence 
matrix is related to A+ and A~ by the equation 


A = At — A™ (no loops) 


where the entries of At and A~ are treated as real num- 
bers. 
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The 


structure of the graph except for the weighting of the 


matrices At and A~ completely describe the 
vertices and branches. It is most convenient to record 


the vertex weights in the form of an » vector 


Wn 


and the branch weights in the form of a diagonal matrix 


of order m 
Be Os 220) 
0 ere) 


OO ee ean 


Then the matrices A+, A~, W, and X describe the net 
completely. 

In certain applications, to sequential machines, for 
example, the distinct branch weights form a discrete set 
and there is at most one branch, which we now denote 
by (i, j, &), from a vertex 7 to the vertex 7 and having a 
given weight &. For the remainder of this section, we 
assume that these circumstances prevail. 

Another class of matrices, useful under the hypotheses 
just stated, relates the matrix X to the matrices A* and 
A-. Vhese matrices, called relation matrices, structure 
matrices, or transition matrices in the various applica- 
tions, are defined as follows. With each distinct branch 
weight & which appears among %1, X2, - + * , Xm, We asso- 
ciate a relation matrix R* = [r,,*] of order n: 


l| 


1 if (7, 7, &) is a branch of the net, 


> 
Il 


0 if (7, 7, &) is mot a branch of the net. 


Thus R* describes the distribution of the branches with 
weight & in the net. Rephrased, the definition may be 
stated thus: r;;*=1 if a branch of weight & has vertices 
(7, 7) and is oriented fromztoJ, 7:;*=0 otherwise. Again 
we notice that the set of matrices R!, R?,---, R?, to- 
gether with the vector W of the weights of vertices, is a 
complete description of the net. 

Finally, we associate with a net still another matrix 
which is very useful for a study of the structure of the 
graph. This is the connection matrix C= |c;;| of order n 
defined as follows: 


Cig = Daa, 


where x; is the weight of a branch from vertex 7 to ver- 
tex j, the “summation” )\’ is over all such branches, 
and c;;=0 if there is no such branch. The meaning of the 
operation of “addition” used here depends on the par- 
ticular application. A similar remark applies to “multi- 
plication.” However, in all cases we preserve the rules 


s+0=0-+x=x%, 0-x=x-0=0, and 1-x=x-1=x. 
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We note that the matrices C and W give a third com- 
plete description of the net. The relations between the 
matrices A+, A~, R!, R2,---+, R®, C, and X involved in 
these descriptions are given in the following two theo- 
rems. 


Theorem 1: C = AtX(A7)?. 


Here the superscript 7 denotes the transpose, and ma- 
trix multiplication is performed in the usual manner. 

We observe first that since X is diagonal, A*X differs 
from A* only in that the kth column is multiplied by 
x,. This is meaningful since the sole nonzero entry in the 
jth column of A* is a 1 in the 7th row where branch 7 is 
directed from vertex 1. Now there is a nonzero entry xX, 
in the 7th row of A*+X with a “1” in the corresponding 
position of the jth column of (A~)” for each branch k 
which is directed from vertex 7 to vertex 7. Hence the 
ij-entry of the product A+X(A7)? is precisely }0/x, = 
Cij- 


Dp 
Theorem 2: C = >) &R*. 


This follows at once from the definitions of C and the 
IRS, 


C. The Paths of a Net 


A primary concern of our later work will be the paths 
of a net. A directed path of length r from vertex v; to ver- 
tex v; is a set of r branches of the form (v;, vx), (Vi, Yio)s 

- + +, (Y,_,, ¥;) provided such branches exist in the net. 
If <=j, the path is closed and is called a cycle of length 
r. If Ui, Vey °° * y Uep_zy Vj are all distinct vertices, the path 
is a proper path and 0; is its initial vertex, v; its terminal 
vertex. If v;=v; but no other two vertices coincide, the 
path is a proper cycle. In particular, a loop is a proper 
cycle of length 1. A path or cycle which is not proper is 
redundant. 

In a net of m vertices, a proper cycle of length n, if it 
exists, is called a directed Hamilton line. Not all nets 
contain directed Hamilton lines. 

It is clear that whenever there is a redundant path 
from a vertex v; to a vertex v; in a net, then there exists 
also a shorter, proper path from 2; to v;. The proper 
paths of a net are of particular interest in the applica- 
tions. Accordingly, our first effort is directed toward 
their systematic identification. . 

For this purpose we let the synbol c;; itself be a 
weight for the branch from 7 to 7 if there is just one such 
branch. If there is no such branch, we let c;;=0. If 
there is more than one branch from 7 to 7, we denote 
these by ¢:;, ¢;,++-+-and put c j= >>*'c,;, where 
addition has in effect the meaning “or.” For this set of 
branch weights, C= [c;;] is the connection matrix of the 
net. 

First we consider the matrix C2, which is formed from 
C in the usual way, multiplication of the entries being 
associative and distributive with respect to addition, 
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but mot commutative. If we now interpret multiplication 
to mean “and” and addition to mean “or,” the entries 


n 
oS CikCkj Ore 


k=1 


list all the paths of length 2 of the net, both proper and 
redundant. More generally, we have this theorem. 


Theorem 3: The entries of C4 list all paths of length q, 
both proper and redundant, of the net. 


The 77 entry of C7 is, in fact, 


» CikChyk, °° * Ck ad) 
(k) 


which either vanishes because certain of the Cas’s are 
zero, or else represents a (possibly redundant) path of 
length g from 7 to 7. Moreover, every path of length g 
from 7 to j is represented in this sum. 

Now let 7,; denote a product Cix,Ckyry °° * Ckp_1j Tepre- 
senting a proper (but not necessarily unique) path from 
v; to v; in the net. Let 7; denote a proper path from v; 
to v; passing through v;, etc. Then we postulate that 
these path products be combined according to the laws 
shown in Fig. 4 

Then, since all redundancies are combinations of 
these three kinds, if a product representing a proper 
path is added to a product representing a redundant 
path containing that proper path, the sum reduces to 
the symbol for the proper path. 

Evidently C is the matrix of proper paths of length 1. 
C? is the matrix of all paths of length 2. The sum C?+C 
must then be the matrix of all proper paths of length 
<2 by the results of the preceding paragraph. Proceed- 
ing thus, we obtain finally the following theorem. 


Theorem 4: Exactly the proper paths of length <q of a 
net with connection matrix C are given by the matrix 


q 
Cy = C*. 
k=1 


The main diagonals of C, list the proper cycles of 
length <g. Since a directed Hamilton line is defined as a 
proper cycle of length n, the directed Hamilton lines of the 
net will be the diagonal terms with n factors in Cy. 

Now let P, denote the matrix whose entries ;; repre- 
sent, as sums of products of g factors, all the proper 
paths, of length exactly g, from 7 to 7 in a net with con- 
nection matrix C. Since any proper path of length q, 
g=>2, may be regarded as a combination of a branch and 
a proper path of length g—1, we have an alternative and 
more practical rule which avoids many complex redund- 
ancies by eliminating in advance the simpler redundan- 
cies from which they arise. 


Theorem 5: P,;=C; P, may be found from the product 
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Fig. 4—(a) mis triimij = tig, (D) weg brig = mii, 


C) Wetkj +H TeRTEIT I = Tek}: 


PAC by rejecting as they appear all terms in which any 
subscript appears more than twice. 


Finally, since there are only m distinct subscripts 
available, any nonvanishing product CyyksCioks * + * Chg ykg 
with g>m must necessarily involve some subscript more 
than twice and hence must represent a redundant path. 
(Another way to see this is to note that any proper path 
from 7 to 7 can pass through at most m—2 intermediate 
vertices if 77 and at most m—1 intermediate vertices 
if 7= 7.) If p is the length of the longest proper path in C, 
we have then p<m. We may therefore state the follow- 
ing result. 


Theorem 6: For a given net, there exists a unique post- 
tive integer p<m (p 1s the length of the longest proper 
path in the net) such that 


Pp p 
Cita = Cp. ey Chia Pe 
k=1 k=1 


for all positive integers q. 


As an example of how these theorems are applied, 
consider the graph in Fig. 5. 
We have 
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CD 


R23 
“s9 
Rites, Sy 
from which, readily, 
012021 0 C120 23 
P2 = }\ 623631 (Co1C12 “ie 23C32) 0) 
32021 031012 32023 
and 
612° €23°C31 0 0) 
a 0 €23° 031° C12 0 
0 0 €31° C12° C23 


Note that P,, is always the matrix of the Hamilton 
lines of the net, a fact which is illustrated here by P3. 

There is a simple algorithm for computing the proper 
paths joining two given vertices v; and v;. We note first 
that all such paths are given by the simplified form of 
the sum 


Do Cik Ce yksCkas ++ 


ee Gy ot Dd, Cinch 
k ky ,ke 

terminating with the sum of products of m—1 factors if 

1%j and with the sums of products of m factors if 7=j. 

The summations need to be extended only over sets of 

subscripts which are all distinct since only proper paths 

are desired. 

This sum may be constructed from the connection 
matrix C by the following procedure, which involves the 
successive “removal” of vertices other than 7 and j. If 
we wish to begin by removing vertex k, we first add 
the product Ca: Cg to each entry Cag of C, thereafter de- 
leting row & and column k from the matrix. 

Possible connections such as Cra, Caa, etc., shown 
dotted in Fig. 6, have nothing to contribute to proper 
paths from a to 6. Thus any proper path or part of a 
path involving vertex k is still accounted for. 
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Fig. 6. 


Starting with the resulting matrix, we remove another 
vertex by the same procedure and continue thus until 
we obtain a second-order matrix of the form 


& | 
Voi Bai 
which provides the desired sum ¥;;. 

In this process we simplify as we go along, since this 
often forestalls the appearance of many symbols for 
more complex types of redundant paths which might 
otherwise be encountered. 

If we now remove vertex v; in the same manner, the 
end result is simply a single expression y,;. It includes 
the term c;; if there is a loop at v;. This is acceptable 
since such a loop is by definition a proper path. How- 
ever, no loops at other vertices than v; appear in any of 
these terms. 


To illustrate the process, consider the net shown in 
Fig. 7. Denoting the result of removing node 3 by Cg, 


(C21 + C23€31) C22 


from which Y=» and Yo =¢21+ 23631. Now removing 
node 2, we have 


Cece = Yun = C1 + €13€31 + C12C21 + 012023031) 


which lists the proper cycles from v; back to 2; again. 

The fact that this algorithm does not include loops at 
vertices other than v; is a disadvantage in certain ap- 
plications. 

The results of this section may be applied to undi- 
rected graphs by the simple expedient of putting ¢:;=c;i 
in every case. The matrix C is then symmetric, which 
simplifies the work to some extent, but the basic facts 
and procedures remain the same. 
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CONCLUSION 


The generality and the wide applicability of the idea 
of a net are an indication of its importance as a unifying 
concept. In succeeding papers we shall use the results 
given here to develop our matrix calculus for the theory 
of sequential machines. 
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A Design Technique for Pedestal-Free 
Switching Circuits* 
GEORGE SEBESTYENT 


Summary—The fundamental differences between mechanical 
and electronic switching circuits are discussed with special emphasis 
on the problem of pedestals. Based on the fundamental differences 
it is shown that Boolean algebra fails to express practical require- 
ments of electronic switches. 

This paper takes a step in the direction of removing this limitation 
by augmenting the ON-OFF notation of Boolean algebra by a nota- 
tion of inequalities to handle the problem of pedestal-free switching. 

The ideal electronic relay is defined and a diode network realiza- 
tion is synthesized. An electronic switch is synthesized to illustrate 
the design technique’s application. Photographs showing the per- 
formance of the circuits are given. 


ITH the advent of general purpose computers 

and other large scale devices, it has become in- 

creasingly important to take the art out of the 
design of switching circuits and invoke the use of a 
systematic approach made possible through the medium 
of Boolean algebra. The end result of this latter method 
of attack is a network topology of interconnected con- 
tacts, some normally open, others normally closed. 

At this point, the theoretical work comes to an end 
and the engineer is faced with the difficulty of translat- 
ing his network of contacts into a fast-acting electronic 
switching circuit. The principal obstacle in the path of 
the transition from the network of contacts to its elec- 
tronic counterpart is the failure of electronics to supply 
the ideal building block instrumented so perfectly by a 
relay. Stating this differently, the obstacle is the failure 
of Boolean algebra in its ideal form to express practical 
requirements of electronic circuits with the precision 
with which it can express the actual operation of me- 
chanical switches. The object of this paper is to take 
a step in the direction of removing this limitation by 
augmenting the ON-OFF notation of Boolean algebra 
by a notation of inequalities to handle the problem of 
pedestal-free switching in electronic circuits. 

In strictly digital switching, the lack of an ideal build- 
ing block does not prove to be a serious defect, for the 
digital switch is required to transmit no more informa- 
tion than that the switch is ON or OFF. In the switching 
of analog quantities or continuous functions, however, 
the switch requirements are much more severe. Instead 
of merely stating that it is now ON or OFF, the switch 
must transmit or discontinue to transmit the flow of 
arbitrary information. The requirement on the part of 
the electronic switch to provide only a continuity or a 
discontinuity of the flow of information is hindered by 
the unwanted appearance of the switching signal com- 


* Manuscript received by the PGEC, January 25, 1957; revised 
manuscript received, May 10, 1957. 
t Research Dept., Melpar, Inc., Boston, Mass. 


manding the circuit to change from one state to another. 
This unwanted switching signal in the output is some- 
times called the pedestal, because it is a de signal or a 
pulse on which the information appears superimposed as 
if on a pedestal. The presence of this pedestal makes 
most electronic switches fall short of the goal for finding 
an exact high-speed equivalent of the relay. 

In many applications the switching signal can be 
eliminated by conventional filtering. This is possible 
where the principal portion of the signal spectrum and 
the spectrum of the switching signal do not overlap. 
Most often, however, simple filtering will not provide a 
suitable solution—at least it is not a general solution 
that gets to the root of the problem. 


PROPERTIES OF MECHANICAL AND 
ELECTRONIC SWITCHES 


The principal building block of switching circuits is 
the ideal relay shown in Fig. 1(a). It is used as a two- 
terminal device which is a short circuit between termi- 
nals 1 and 2 if the energizing coil a is suitably excited, 
and it is an open circuit between terminals 1 and 2 when 
a is not energized. These two states are the 1 and the 0 
states of the contact A, respectively. Although the de- 
vice itself has only two terminals, it is almost always 
associated with a four-terminal application in analog 
switching. In the four-terminal network [Fig. 1(b) ], the 
relay will transmit the information /, if Ad =1 and will 
not transmit it to the output if A =0. The two-terminal 
pair device [Fig. 1(b)] is a better, practical representa- 
tion of a relay contact as it is used. After all, relays are 
used to transmit or interrupt the flow of information and 
information in electronics always appears across a pair 
of terminals. Since it is convenient to take the input and 
output voltages with respect to the same potential, and 
since this does not result in a loss of generality, it is 
proper to represent a practical relay contact as the 
transfer function implied by the circuit of Fig. 1(b). The 
transfer characteristics of the ideal relay of Fig. 1(b) are 
listed below: 


Ey = Ey 
E, 


if A =1; 


undetermined or floating if A = 0. 


This latter characteristic of a switch, that the two termi- 
nals of the output have no definite relationship to each 
other if the switch is open, is a unique property of 
switches brought about by the mechanical separation of 
the input and output terminals which takes place when 
a relay contact is broken. No such break occurs in an 


1957 


I i anal 2 io tj 102 
| Ree ier, 
ry e, | ies 
| | 
a Z | | = 
Sar eas aaa Pac, 
(a) (b) 


Bias, or Gating Signal 


Fig. 2—Vacuum tube switch. 


electronic network with no moving parts, and conse- 
quently, terminals across which information may ap- 
pear at one time must be fixed and cannot float with 
respect to each other at other times. 

Consider the vacuum tube circuit of Fig. 2, for exam- 
ple. When the grid is biased in the linear amplification 
region of the tube, information can pass from the grid to 
the plate circuit, and the tube may be regarded incre- 
mentally as an energized relay. When the grid is biased 
highly negative, the tube is at cutoff and transmits no 
information to the plate circuit. In this respect, a cutoff 
vacuum tube may be thought of as an open switch. In 
reality, however, it is far from being that. As pointed out 
above, the output voltage of an open switch is unde- 
termined. The output of a cutoff vacuum tube amplifier 
is fixed at some potential such as the potential of. the 
plate supply voltage in the example above. The situa- 
tion is similar if devices other than vacuum tubes are 
considered as the switched elements. For this reason, it 
is practical to redefine the meaning of a switch as used 
in electronics by returning the output to a fixed refer- 
ence, such as ground, in the unenergized state. It may 
be stated, therefore, that the output of an ideal elec- 
tronic switch is equal to the input when the switch is 
ON and is identically equal to zero when the switch is 
OFF. Fig. 3(a) is the ideal switch whose electronic 
counterpart is now defined as a circuit realizing the 
grounded transfer contact network shown in Fig. 3(b). 
This definition is a particularly reasonable one in view 
of the constant strife for building better switches which 
exhibit no pedestals. 


SoME OPERATIONS IN AN ALGEBRA 
OF INEQUALITIES 


Before the synthesis of circuitry can be undertaken, a 
departure from the main subject must be made to dis- 
cuss some basic algebraic operations to be used later on. 
The two operators to be used are symbolic representa- 
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Fig. 4—Illustration of ¢+ and ¢~ operations. 


tions of the words “most positive” or “greatest” and the 
words “most negative” or “least.” It is beyond the 
scope of this article to discuss all the interesting proper- 
ties of an entire algebra of inequalities built around these 
two operations.! Here, use is made only of the two 
above mentioned operations denoted by ( )¢*+ and 
( )¢-. The operator ( )d* selects the greatest or most 
positive member of a set of quantities appearing as its 
argument. The operator ( )¢~, on the other hand, se- 
lects the least or most negative member of the set of 
quantities comprising its argument. To illustrate the 
usefulness of these operators in the analytical descrip- 
tion of switching circuits, consider the following exam- 
ple. Of the two time functions shown in Fig. 4(a), e,(¢) 
is a sine wave of unity amplitude and e.(t) is a square 
wave of amplitude three. If e:(¢) and e:(¢) are made the 
argument of the ( )#+ operator, written as [e:(¢), e2(t) |d*, 
then the output is seen to be the sine wave e,(t) from 
t=0 to t=T;, and it is the square wave e(t) from t=T, 
to t=T>. Similarly, if the operation [e,(é), e2(t)|@- were 
performed to select at all times the most negative of 
é:(t) or ea(t), then the output would be the square wave 
for <7, and the sine wave for 7, <t<Tv:, as shown in 
Fig. 4(b). The application to switching circuits is now 
quite evident. The square wave may be regarded as the 
switching or gating signal and the sine wave as the in- 
formation to be switched. The only requirement for 
successful switching is that the peak amplitude of the 
information signal be always less than the gating signal. 
This is easily accomplished in practice. The circuits 
which can accomplish the two basic operations are 
shown in Fig. 5. The circuit of Fig. 5(a) is the instru- 


17. B. Stern, “Piecewise-Linear Network Theory,” Sc.D. Dis- 
sertation, Mass. Inst. Tech., Cambridge, Mass.; June, 1956. 
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Fig. 5—The * and ¢~ operators. 


mentation of the ¢+ operator. The diode whose anode is 
most positive will conduct and will be a short circuit, 
thus causing the output to equal its anode voltage. 
Similarly, the circuit of Fig. 5(b) realizes the ¢~ operator 
because the diode whose cathode is most negative will 
conduct, causing the output to assume the conducting 
diode’s cathode potential. All other diodes are noncon- 
ductive, thus providing isolation of inputs. These cir- 
cuits are suggested to instrument the two basic opera- 
tors.! The ¢+ and the ¢@~ circuits are seen to be identi- 
cally the same as the logical or and the logical and cir- 
cuits of conventional digital switching circuits. This is 
quite reasonable if the ¢* operation is given a strictly 
two-valued interpretation for use in Boolean algebra. 
The operation of addition in Boolean algebra means, for 
instance, that if any one or more of the digits A, B, 
C, +++ appearing in the sum (A+B+C+ ---)isone, 
the sum is one. This is the logical or. Of the two values, 
0 and 1, which the digits may assume, Boolean addition 
selects the highest value present as the sum. This is 
exactly what the ¢+ operator does. In Boolean multipli- 
cation, however, if any one or more of the digits is zero, 
the product (A XBXC-- - ) is zero. This is the logical 
and requiring A and B and C and all the factors of the 
product to be 1 for the entire product to have the value 
unity. Of the two values, 0 and 1, which the digits may 
assume, Boolean multiplication selects the lowest value 
present as the value of the product. This is exactly the 
function performed by the ¢~ operator. It may be 
stated, therefore, that: 


CA Ber Cree ere CA SRG sat be 
= logical or and that 


logical and. 


These two equations hold true not only if the argument 
is 0 or 1 but also if it has highly positive or highly nega- 
tive values. Highly positive or negative voltages are 
more meaningful when talking about analog switching, 
where instead of having closed relay contacts, we might 
have highly positive gating signals, and instead of open 
relays, we might have highly negative cutoff voltages. 
Although stretching the point a bit, the equivalent 
meaning of the Boolean operations and the ¢+ and ¢~ 
operators, as will be seen, is usefui not only if the indi- 
vidual members in the set A, B, C,--- have two dis- 
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Fig. 6—Unidirectional ideal electronic switch with block diagrammatic 
and signal flow graph representation. (a) A,=0 if A=0, Ao=£; 
if A=1; (b) ke=E,\A+04A'; (c) Fp =E,A+0A". 


crete values, but also if they are contained in nonover- 
lapping regions. 

Having introduced the above two equations, the syn- 
thesis of the ideal electronic switch of Fig. 3(b) may be 
resumed. In the case of practical electronic switching 
circuits, the switches used are intended to be unidirec- 
tional. The switch is to have not only two pairs of termi- 
nals, but a set of noninterchangeable input and output 
terminal pairs. This implies that information may flow 
from input to output but not from output to input. In 
this respect, the electronic equivalent of a relay contact 
functions the same way as blocks in a block diagram or 
transmissions in a signal flow graph, both of which 
operate on their input quantities. For this reason, the 
ideal unidirectional electronic switch of Fig. 6(a), where 
the arrows indicate the permissible direction of the flow 
of information, can be represented by the block diagram 
or flow graph of Fig. 6(b) and 6(c), respectively. In the 
equations describing the block diagram and flow graph, 
the second input of 0 is not superfluous. It represents 
the magnitude of the required fixed voltage output of the 
switch in the OFF state. This does not necessarily have 
to be zero. It was defined to be zero merely because no 
pedestal was desired in the output. 

As a result of the preceding discussion, we were able 
to express the output of a switch as the sum of two 
products. Applying the previously derived equivalence 
of @+ operation to addition and ¢~ operation to multi- 
plication, the following equation is obtained: 


Ey = [(A,, A)¢, (0, A’) $7 |9*. 


The term (£,, A)¢@~ describes the product £,A and the 
term (O, A’)¢~ denotes the product of OA’. The sum of 
these two terms is taken by the $+ operator to yield the 
above equation which can be instrumented by the 
suitable interconnection of ¢+ and @~ operators as 
shown in Fig. 7. 

In Fig. 7, EZ; is the signal to be switched and A and A’ 
are the switching signal and its complement, respec- 
tively. If A=0, then the switching signal is highly 
negative and its complement highly positive; if A =1, 
the switching signal is highly positive and its comple- 
ment highly negative, as stated earlier. When the elec- 
tronic switch is to be OFF, the 7) network selects the 
more negative of the information and the highly nega- 
tive switching signal. At the same time the #~ 2) network 
selects the zero input because that is lower than the 
switching signal’s complement. Of the outputs of the 


E,[(E,.A¢,(0,a)¢ ]¢" 


Fig. 8—Network realization of ideal electronic switch. 


two @ networks, the zero output of @~@) is greater. 
Hence, the ¢* operator selects zero as its output. As the 
gating signal is turned ON, the ¢~q) operator passes the 
information signal /, because that is the more negative 
input. The @~.) operator, on the other hand, passes the 
highly negative complement of the gating signal. During 
the ON period, therefore, F; is the more positive of the 
two @~ operator outputs and is passed on to the final 
output by the ¢* operator. 

With this interconnection of @~ and ¢* operators, 
governed by the equation derived from the definition of 
an ideal unidirectional electronic switch, all the initially 
imposed requirements have been met. The signal ap- 
pears with unity gain and without the objectionable 
presence of a pedestal. 

The network which realizes the block diagram of 
Fig. 7 is shown in Fig. 8. The bias voltage B,; is common 
to both ¢@~ circuits. All input terminals must have a dc 
return to ground and should be driven from low imped- 
ance sources. Waveforms at various points in the circuit 
are shown in Fig. 9, and are found to agree with the 
theory as illustrated in Fig. 7. A sine wave is used as the 
information signal. 


Circuit APPLICATION 


Although a unified theory for the synthesis of analog 
switching circuits with the above techniques has not yet 
been completed, the design of a simple switching circuit 
with the above methods would bring out the utility of a 
systematic method of attack. 

Consider the realization of an electronic switch used 
to display the sequential alternation of two input func- 
tions on a single cathode-ray tube. The required contact 
network is shown in Fig. 10(a), where A switches alter- 
natingly between 0 and 1 and A’ between 1 and 0. The 
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Fig. 9—Waveforms in the ideal switch. (a) ¢-«)(4); (b) ¢7@ (4); 
(c) [$-@, ¢ @]¢*. 
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Fig. 10—Electronic switch. (a); (b) Ao=A,A +A; 
(c) Zo=[(Ei, A’)67, (Eo, A) ]6*. 


first step is to draw a signal flow graph, shown in Fig. 
10(b), from which the network equation may be written. 
The network equation may now be transformed into 
the @* notation with the aid of previously developed 
equations. This yields 


Ey = E,A' + ExA = [(Ki, A’)¢-, (E2A) 67] 6+ 


realized by the block diagram of Fig. 10(c). This dia- 
gram is recognized to be identical to that of Fig. 7 with 
the exception that instead of applying 0 to the #7.) in- 
put, the second function £2 is applied. The photographs 
of Fig. 11 show the waveforms when F; is a sine wave 
and F; is random noise. The switching functions are ob- 
tained from opposite plates of a multivibrator through 
a coupling network to obtain a positive as well as nega- 
tive going square wave-switching signal. 
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Fig. 11—Waveforms. (a) ¢7a); (b) ¢7@; (c) [6 w, ¢ @)o°. 
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amplitude of the information to be switched. 

It should be noted that switches which operate on this 
principle also may be instrumented using analog com- 
puter operational amplifier.” 

In addition, by an analysis of the switch, it is shown 
in the Appendix that the crosstalk—the ratio of the sig- 
nal magnitude at the output in the OFF state to that in 
the ON state—can be made close to 2(R;/R,)*, where 
R; is the forward and R, is the reverse resistance of the 
diodes used in the circuit. In practice, this may be a very 
impressively and unmeasurably small crosstalk. 


APPENDIX 


Proor THAT CROSSTALK CAN BE MADE 
CLOSE TO 2(R;/R,)? 


Crosstalk is the ratio of the signal gain in the OFF 
state to that in the ON state. In the circuit below, when 
Aishighly positive and A’ highly negative, crosstalk is the 
ratio of the gain (or attenuation) from ey to @our to the 
gain from @ to @out. Diodes 1, 3, and 5 are conducting 
and 2, 4, and 6 are not [Fig. 12(a) ]. Diodes conducting 
have resistance R;, diodes in the OFF state have re- 
sistances Kk, Each voltage generator has an internal 
impedance R,. The ac incremental circuit is shown in 
Fig. 12(b). Assumptions made are that R, Ro>R,, R). 
If the parallel combination of R, and R is very large 
compared to k;+ R,, then the branch consisting of &, in 
parallel with R between points ab may be neglected. 


es 


Fig. 12. 


CONCLUSION 


In the foregoing, synthesis of a pedestal-free electronic 
switch was described prompted by some algebraic in- 
equality operations. The switch in its final form is a 
simple device and is capable of very-high-speed opera- 
tion. The principal advantage of the device is that by its 
very nature, neither the magnitude nor the shape of the 
switching function are of any consequence insofar as 
successful uniform switching is concerned. In fact, as 
stated earlier, the only required property the switching 
signal must possess is that it be greater than the peak 


Similarly, the right-hand side of the circuit may be 
simplified to look like the circuit in Fig. 12(c). These 
simplications have made use of the valid assumptions 
stated above. The crosstalk is the ratio 


(R; a R,)(2Ry ats R,) 
R? . 


4o/ 14 SS 
If the generator impedance can be made very small, the 
crosstalk would become 2(R;?/R,”), as stated in the text. 


*R. M. Howe, “Representation of nonlinear functions,” IRE 
TRANS., vol. EC-5, pp. 203-206; December, 1956. 
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A New Method for Generating a Function of 


‘Two Independent Variables* 
LAZARUS G. POLIMEROUT 


Summary—A new concept in the design of a function generator 
of two independent variables is presented. This design is of the 
photoformer variety and utilizes pulse techniques to obtain the ad- 
vantages of accuracy and semiautomatic calibration and self- 
correction. With this particular design, many of the objections of 
other types of photoformers, which have been used to generate func- 
tions of single independent variables, have been eliminated, and yet 
this design maintains the desirable aspects of the photoformer. 


INTRODUCTION 


HE generation of an arbitrary function of 
We or more variables is an important computer 

operation. The nature of problems being solved on 
present analog computers is complicated by the need for 
generating such functions. Available methods for meet- 
ing such needs are well outlined by Meissinger.! The 
author now proposes an additional design which has 
the very important feature of simplifying the set-up 
procedure because the function generator is of the 
photoformer type and utilizes pulse techniques to ob- 
tain improved operation. This design is an extension of a 
basic experimental model containing four units, com- 
pleted January, 1953.2 A model based on the extended 
design is now under investigation.?* 


A FUNCTION OF ONE INDEPENDENT VARIABLE 


The basic function generator‘ is composed as follows: 
an electron beam of a crt is made to scan a mask (as 
shown in Fig. 1) at a relatively high sweep rate. As the 
beam passes the reference line of the mask, a pulse is 
produced by a photomultiplier tube which looks only 
at this reference line. The beam continues to move and 
scans past the function line of the mask, whereupon a 
second pulse from a second photomultiplier tube, look- 
ing only at the function line, is produced. The time de- 
lay between these two pulses is directly proportional to 
the length of the ordinate between the reference line and 
the function line, assuming a linear sweep. These two 
pulses are then shaped and fed into grids of a flip-flop 
circuit which produces a square wave that has a width 
proportional to the time delay between the pulses and 


* Manuscript received by the PGEC, February 20, 1957; revised 
manuscript received, April 21, 1957. This paper is based on a thesis 
submitted for the M.S. degree to the Dept. of Elec. Eng., Southern 
Methodist University, Dallas, Texas, 1957. Patent pending. 

{t Convair, Fort Worth, Texas. 

1H. F. Meissinger, “An electronic circuit for the generation of 
functions of several variables,” 1955 [RE CONVENTION RECORD, part 
IV, pp. 150-161. 

2 At White Sands Proving Ground, N. M. 

3 At Convair, Fort Worth, Texas. 

4L. G. Polimerou, “A new method of generating functions,” 
IRE Trans., vol. EC-3, pp. 29-34; September, 1954. 
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Fig. 1—Function slide for function of one independent variable. 


that has a constant amplitude. In this process, the first 
pulse initiates the square wave and the second pulse ter- 
minates the square wave. Thus a train of square waves 
is produced. The square waves are then rectified and 
integrated, thus producing a varying dc voltage that is 
proportional to the ordinate between the reference line 
and the function line; 7z.e., a voltage proportional to the 
value of the function at the point being scanned. 

As the ordinate length varies, so does the output volt- 
age. By moving the scanning line (in a direction per- 
pendicular to the scan, called the independent function 
axis) over the mask which represents the dependent 
function, the ordinate lengths can be made to vary with 
respect to the position of the scan. If the scanning line is 
moved in a linear fashion with respect to time along the 
independent axis, a voltage is produced in the output 
which is the electrical replica of the mask, as given in 
Fig. 1. Furthermore, the scanning line can be moved in 
a nonlinear manner along the independent function 
axis, thus producing a function of a function. 


A FUNCTION OF Two INDEPENDENT VARIABLES 


Having examined the basic design, a further applica- 
tion of this design is considered. Referring to the original 
slide (Fig. 1), the function line is replaced by a whole 
family of curves (Fig. 2). The same reference line is 
maintained. 

Now consider the scanning point of light as it crosses 
the slide. When it first crosses the reference line, a pulse 
is produced by a photomultiplier tube which, when 
shaped, is used to initiate a square wave in a number of 
parallel flip-flop circuits (Fig. 3). The scanning point 
continues to scan across the slide until it crosses the first 
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Fig. 2—Function slide for function of two independent variables. 
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Fig. 3—Pulse distribution schematic. 


function line, at which time a second photomultiplier 
tube produces a pulse which is sent out to all parallel 
flip-flop circuits. This first function line pulse terminates 
the square wave in flip-flop number one. However, it does 
not terminate any of the other square waves in the other 
parallel flip-flop circuits because these flip-flops are 
made to respond in succession according to the number 
of function pulses corresponding to their position on the 
slide. Next, as the spot of light crosses function line 
number two, a second function line pulse is produced 
which is sent out to all parallel flip-flop circuits such that 
this pulse terminates the square wave in flip-flop number 
two. Now, the second terminating pulse does not affect 
flip-flop number one, because the square wave at that 
point has already been terminated. Furthermore, it does 
not affect any of the other parallel flip-flop circuits, since 
each parallel flip-flop circuit will respond only to its own 
certain number of pulses corresponding to its order of 
succession on the slide. Similarly, it takes three pulses to 
terminate flip-flop circuit number three and four pulses 
to terminate flip-flop circuit number four, etc. Once 
more the retriggering of the reference pulse again initi- 
ates square waves in all parallel flip-flop circuits and the 
process is repeated. 

Now by processing the outputs of these flip-flop cir- 
cuits as in the basic design, it is possible to produce 
many functions on just one slide. (These functions are 
considered not to cross one another, although crossovers 
can be handled.) This result is very useful in itself. 
However, we have not as yet produced a function of two 
independent variables. 
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Fig. 4—Three-dimensional representation. 
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Fig. 5—Cross section of three-dimensional representation. 


If switching elements are now used which will select 
the desired flip-flop circuit output according to a varia- 
tion of a second independent variable, then the output 
will be a function of two independent variables. These 
switching elements may be high-speed relays or other 
electronic devices. Examining Fig. 4, it is found that the 
ordinate of the surface is the value Z which is selected 
according to both X and Y. Next, if a cross section of 
the surface in which X is a constant is examined (Fig. 5), 
the following analysis can be made. The values Z,, Zz, 
Z3, Z4, and Zs represent discrete values of Z as formed 
by a set of points (constant X value) on the slide (Fig. 
2). Now since it is desired to have intermediate values of 
Z corresponding to intermediate values of Y, linear in- 
terpolation is performed. At a point Z,=2Z3+AZ, corre- 
sponding to Y,, AZ, is determined thusly, 

La — 23 AZ 


— i 
Vom sat oma 


m being the slope between Z; to Z; which may be ex- 
pressed by 


Therefore, 


1957 


a ee LINE NO. 2 


‘Ne REFERENCE LINE NO. 1 


Fig. 6—Function slide for Z-axis automatic calibration. 
which for circuitry is written 


1 
AZ = a [Zs(Va — Vs) — Z3(Y. — Ys). 


It is seen that Z; and Z, are proportional to the width of 
the square waves formed at the respective flip-flops con- 
cerned. Amplitude modulation of these square waves ac- 
cording to (Ya— Y3)/25 will produce the desired multi- 
plication when the train of pulses from each flip-flop 
circuit is averaged, respectively. Consequently, the 
proper value of Z is selected according to both inde- 
pendent variables X and Y. 

The following items concerning the basic design of 
this function generator are pointed out. First, in com- 
paring this type of function generator with any other 
type photoformer, a parallel extension of the method 
described (in which instead of merely one function per 
slide being generated, many functions can be generated 
on a single slide) can not be duplicated on other present 
type photoformers. 

Second, changes of beam light intensity do not af- 
fect the output of this function generator. Since if for 
some reason the intensity of the electron beam is. in- 
creased causing an earlier triggering of the reference 
pulse, a similar earlier triggering will occur for the func- 
tion pulse. The area under the generated square wave 
remains the same, therefore, the value of the function is 
not distorted as it would be in other types of photo- 
formers. 

Next, by the addition of a second reference line (Fig. 
6), automatic calibration in the direction of scanning 
circuit can be had. For since the output of a second ref- 
erence line (parallel to the first) should be constant, it 
can be set against a laboratory standard and maintained 
whereupon proportionate correcting voltages can be 
sent out to functions within any particular zone of the 
slide. This tends to decrease any inaccuracies due to 
auy nonlinearities in the sawtooth scanning waves. 
Whereas in other types of photoformers it is necessary 
to set gains on both X and Z axes (thereby making it 
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Fig. 7—Simplified system block diagram. 


difficult to determine whether an error which exists in 
some output voltage is due to improper input gain 
setting or improper output gain setting or to what 
combination in both), such is not now the case in this 
function generator. In this pulse-type function genera- 
tor, guessing the error in the Z direction or scanning di- 
rection (corresponding to output voltage gain) is re- 
placed by a self-correcting and self-calibrating device. 

Next, generating several functions of time on a single 
slide simultaneously, decreases the possibility of poor 
synchronization which may occur when functions are 
placed on a separate slide. Also, movement of the slide 
in the direction of scanning does not affect the output of 
the function generator. 

Furthermore, this basic function generator design is 
compatible with the box-type multiplier, so that, in 
every case in which a unit is not used to generate a 
specific function, each unit can then be made available 
to give multiple-multiplication outputs. 

In comparing this function generator to diode func- 
tion generators, it has the advantages of a simple set-up 
and also storage of the information on the slide. 


CONCLUSION 
Features of this type system are enumerated below. 


1) High accuracy—better than 4 per cent. 

2) High-frequency response—flat to beyond 100 
cycles per second. 

3) Elimination of curve riding errors. 

4) Automatic output calibration. 

5) Self-correcting scanning system. 

6) Availability of multiple-multiplication channels 
when not generating a function of two independent 
variables. 

7) Generation of many functions on a single slide 
simultaneously. 

8) Simple set-up for functions to be generated. 


A simplified block diagram of the system is given in 
Figi is 
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An Analog Method for the Solution of Probability of 
Hit and Related Statistical Problems” 


THOMAS B. VAN HORNET 


Summary—Approximate solutions of probability of hit problems 
have been achieved by means of a simulation involving a masked 
oscilloscope and photocell for the target and samples from random 
noise generators for the system dispersions. The method is described 
in general and its possible application to other noise and statistical 
problems indicated. The statistical limitations on accuracy and com- 
putation rate, inherent in such a sampling method, are analyzed for 
an idealized probability of hit problem which may be used as a guide 
in choosing appropriate noise spectra for the mechanization of similar 
problems. 

Examples which illustrate two types of restrictions on the noise 
spectra arising in amplifier bandwidth and screen response are con- 
sidered in detail and the statistical relationship between computa- 
tion rate and accuracy determined for spectra shaped by some simple 
RC filters. 


VALUATION of weapon system effectiveness 
iD commonly involves a calculation of the arma- 
ment probability of hit by integrating the error 
distribution over some sort of irregular vulnerable area. 
In any but the simplest cases the calculation may prove 
tedious. One approach, which has proven successful for 
airborne rocket fire control systems and should be useful 
in many related problems, is outlined in this paper. 

A sampling method! is employed in conjunction with 
electrical analogs of the system and target. The basis of 
the simulation is an oscilloscope with its screen covered, 
except for a portion in the shape of the target vulnerable 
area. Gaussian or other noise and constant voltages are 
applied to the horizontal and vertical deflection plates 
to represent system and rocket dispersions and biases. 

With proper scaling the probability of hit is equal to 
the average fraction of time which the spot is within the 
vulnerable area. This may be determined by integrating 
the output of a photomultiplier tube placed in front of 
the screen. Alternatively, the oscilloscope intensity may 
be periodically pulsed and the photomultiplier output 
pulses counted and compared with the total number of 
pulses in the same interval. 

The method is applicable to several other types of 
statistical problems. The following examples indicate 
some of the possibilities. 

A convenient way to measure the cumulative prob- 
ability distribution of a noise voltage is shown in Fig. 1. 
With an ideal diode the density function of the vertical 
input for a noise with density p(v) is like that of Fig. 2. 
If the edges of the mask are scaled to +a volts the 
probability of a sample appearing in the cutout is 


* Manuscript received by the PGEC, March 26, 1957. Part of 
this work was done under Contract AF 33(600)-23101. 

+ Hughes Aircraft Co., Culver City, Calif. 

1P, M. Morse and G. E. Kimball, “Methods of Operations Re- 
search,” John Wiley and Sons, Inc., New York, N. Y., p. 122; 1951. 
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Fig. 1—Circuit for the determination of cumulative 
probability distribution. 
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Fig. 2—Probability density of the vertical input. 
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The diode action of the circuit is essentially perfect if 
the region between +3 volt and, of course, very high 
voltages are excluded. This is accomplished if a@ is ap- 
proximately 1 volt or greater. 

If a narrow slot is cut in the mask, it is possible to 
count the average number of crossings per second at a 
given level for an arbitrary noise. An analytical solution 
has been given by Rice:? 


expected number of zeros per second 


ilaeal sy sO 
sel aa caine 


where ¢(r) is the autocorrelation function of the noise. 
An experimental determination of this quantity can be 
useful in a problem to be discussed later. 

A mechanization of the method for the automatic 
tracking problem, discussed by Laning and Battin,’ is 


2S. O. Rice, “Mathematical theory of random noise,” Bell Sys: 
Tech. J., vol. 24, p. 51; January, 1945. i 
° J. H. Laning and R. H. Battin, “Random Processes in Auto- 
matic Control,” McGraw-Hill Book Co., Inc., New York, N. Y. 
p. 163 ff.; 1956. 
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Fig. 3—Mechanization of the automatic tracking problem. 


shown in Fig. 3. A signal y(t) and noise x(t) are applied 
to a servo with resultant output 2(¢). Tracking will be 
assumed lost if z(t) — y(t) exceeds a bound a. The system 
performance may be described by the probability that 
it loses track in a specified interval At. 

The mask in this case covers the region between +a 
so that the photocell will record only excursions outside 
the bound. Pulse generator 1 has a repetition frequency 
high enough to closely sample the vertical input. Pulse 
generator 2 defines the interval At by resetting the 
flip-flop at the beginning of each interval so that only 
one pulse per interval can be counted by counter 1. 
The ratio of the two counts is thus the probability of at 
least one excursion beyond +a in the interval At. 

These examples illustrate types of problems to which 
the method is applicable. Others have been discussed by 
Favreau, Low, and Pfeffer,t who give solutions by the 
more conventional analog methods. 

Some time-varying problems may be conveniently 
handled by utilizing the freedom of the two-dimen- 
sional presentation. For example, if a linear sweep is 
applied to the horizontal input in the tracking example, 
the mask may be cut to make the bound a an arbitrary 
function of time during the interval. 


DESIGN CONSIDERATIONS 


Instrumentation of the method for a particular type 
of problem generally involves compromises between cir- 
cuit technique, accuracy, and computation rate. Limita- 
tions inherent in circuit technique may occur in the 
operational amplifier bandwidth, oscilloscope screen re- 
sponse, counting circuits, etc. These factors define or re- 
strict the noise spectra which may be used, in a manner 
depending upon the mechanization. 


4R. R. Favreau, H. Low, and I. Pfeffer, “Evaluation of complex 
statistical functions by an analog computer,” 1956 IRE CONVENTION 
REcorRD, part IV, pp. 31-37. 
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Two general classes of problems are encountered. The 
noise characteristics may be specified by the problem, or 
the noise may merely furnish random samples. In the 
former case, it is necessary only to choose the proper 
time-frequency scale to provide minimum computation 
time consistent with the circuit limitations. In the latter 
case, there is considerable freedom in the choice of the 
spectrum, and it may be necessary to examine the possi- 
bilities for optimum accuracy and computation rate. 

Since an error analysis of the solution is generally 
much more difficult than the problem itself, it is nec- 
essary to use results obtained for simple examples of the 
problem type as a guide. 

A representative probability of hit problem has two 
independent normally distributed aim dispersions with 
equal variance ¢o, directed at the center of a square 
target with side 2a. The analytical solution is simply 


it a 2 
IPS | f celine | (3) 
270 —a 


and tabulations of the integral are readily available. To 
mechanize this problem, the aim dispersions are simu- 
lated with Gaussian noise generators having an auto- 
correlation function $(r) applied to the deflection plates 
and a mask with a properly scaled rectangular cutout 
placed over the screen. The photocell output voltage is 
adjusted to unity if the spot is inside the cutout and 
zero outside. The output is integrated for a period 7’ and 
the result divided by T to obtain a mean voltage equal 
to the sample probability of hit, P,,. Considering only 
the errors resulting from the noise statistics the expected 
mean square fluctuation in Py, is given by® 


Dy g x 
op? = alt (1 — =) (A(x) — Pr?|dx, (4) 


where @(r) is the autocorrelation function of the photo- 
cell output. For large T, 


W(0+) 
ib 


2~ 


oP (S) 
where W(f) is the power spectral density corresponding 
to A(r). 


W(f) = 1 fo) cos 2nfrdr. (6) 


In order to increase confidence in the sample prob- 
ability of hit, it is necessary to increase the integration 
time for a given noise spectrum. 

If the oscilloscope intensity is pulsed with period 7» 
and the integration performed by counting these sam- 
ples of the photocell output, the dispersion will be in- 
creased.® We have 


5 W. B. Davenport, Jr., R. A. Johnson, and D. Middleton, “Sta- 
tistical errors in measurements on random time functions,” J. Appl. 
Phys., vol. 23, p. 377; April, 1952. 

6 Thid., p. 380. 
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where V,=number of hits, 4 =total number of pulses. 
To increase the accuracy it is thus desirable to use as 
many samples as possible which, however, also in- 
creases the computation time, V7». 

Assuming that Gaussian noise characterized by (7) 
is passed through a nonlinear filter F(x), the correlation 
function of the output may be obtained by a method 
given by Laning and Battin’? for the solution of the 
similar problem of noise through a limiter. 

In general, 


6(r) = jf au [ dug (u)q(v)e-1/2 @ou"-+2durtgov") (9) 


{/ q(uje*du. 


—o 


where 
F(x) = (10) 


For independent Gaussian sources applied to a two-di- 
mensional filter 


F(x, y) =|) as duq(s)r(ujer este) , 


we have 


7) = fafa fe auf das arr 


«1/2 (h08"+24st+hot”)—1/2 (Sou +2puvtgov") | 


(11) 


(12) 


The oscilloscope, mask, and photocell have a filter char- 
acteristic 


1 | «| <a and | y| <4 
F(x, y) = (13) 
0 | «| >a or | y| >a 
which has an integral representation 
sin as sinau | 
(x,y) = =f cas fas eltestyu) (14) 
u 
Thus, 
sin au 
q(u) = r(u) = , (15) 
TU 
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(16) 


Using a series expansion for the exponential, this may be 
written 


7 Laning and Battin, op. cit., p. 169. 
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Following the method of the above reference this expres- 
sion may be reduced to 


Noting that the terms for n=1, 
have 


(18) 


O(r) = [Pa + S(o)]? (19) 
where 
as oe att —— [e7/(+e) — e~ 2") Ap) | (20) 
dp~ iy lene 
with 
pe) = 2 (21 
po 
a 
r= res (22) 


Difficulties in numerical integration in the vicinity p=1 
may be avoided by an independent calculation from the 
density function of the photocell output which may be 
written 


p(v) = (1 — Pr)d(v) + Pid(v — 1) (23) 
from which 
9(0) = [ *0ae = Py =i Pp eee le (24) 
thus 
S(1) = VPi — Pr. (25) 


Fig. 4 gives @ as a function of p(r) for several values 
of a?/do. Using these curves it is possible to obtain the 
autocorrelation function of the photocell output for any 
Gaussian noise source. The expected mean-square error 
in the sample probability of hit is then given by (4), (5), 
or (8). 


Examples of Design 


The following examples serve to illustrate the applica- 
tion of the results of the preceding section to a problem 
where amplifier bandwidth limits performance and to 
one where the oscilloscope screen response is the limiting 
factor. 


SIMPLE PROBABILITY OF HIT 


A mechanization of the problem discussed with re- 
gard to statistical errors is shown in Fig. 5. The oscillo- 
scope screen would limit the accuracy if the response 
time to the limiter output of —1 volt becomes com- 
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Fig. 5—Circuit for the determination of probability of hit. 


parable with the average length of time the spot spends 
within the cutout. This results in a rounding of the 
normally rectangular output voltage to the integrator 
which depends on the noise bandwidth, and its variance 
with respect to the target dimensions. The amplification 
between the photomultiplier and the limiter effectively 
improves the screen response but is limited by noise 
from the photo tube. The effects of these circuit factors 
cannot be described in a simple manner. 

Another limitation arises from the response of the 
operational amplifiers. In this simple problem the am- 
plifier response could normally be taken into account 
directly. However, if several sources of dispersion af- 
fecting both channels are to be combined in several am- 
plifiers it becomes necessary to insure that the rms noise 
voltages are not affected significantly by the amplifiers. 
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A possible criterion which eliminates this source of 
error is to restrict the noise bandwidth such that only 
one per cent of the total noise power is contained in fre- 
quency components above a maximum frequency fm, 
determined by the operational amplifiers. If the basic 
noise source has too wide a power spectrum its output 
must be filtered until it is consistent with the above re- 
quirement. 

The characteristics of three of the many possible 
filters, Y(f), are given in Table I which compares single, 
double, and triple isolated, RC, low-pass networks with 
white noise input. The expected variance, op’, of the 
measured P;; was determined for large T using Fig. 4 
and (5) for ¢o =a’. 


WAIT, I 


CoMPUTATION EFFICIENCIES OF RC Low-Pass FILTERS OF 
MAXIMUM FREQUENCY fm 
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It is apparent from Table II that a sharp frequency 
cutoff characteristic is desirable if the maximum fre- 
quency criterion is used since, given fm and op?, the 
triple RC filter allows over ten times as high a computa- 
tion rate as the single RC filter. 


Airborne Rocket Fire Control System 


As an example of a problem to which this method 
may be profitably applied and which illustrates the 
manner in which screen response may limit the ac- 
curacy and computation rate, consider the case of a 
salvo of unguided, contact-fuzed rockets, launched, 
equally spaced in an interval which is short compared 
to the response time of the control system of the launch- 
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Fig. 6—General arrangement for determining 
rocket probability of hit. 
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ing aircraft. The motion of the aim point along the tar- 
get during the salvo is then a function only of the rela- 
tive velocity and attack geometry. It will be assumed 
that one hit in the given vulnerable area is sufficient for 
a kill so that only the first hit in a salvo should be 
counted. Random errors in the rocket trajectories due 
to aiming errors and rocket dispersion must be con- 
sidered separately, but each may be assumed independ- 
ent and normal in two dimensions. Four independent 
noise sources are thus required. 

A block diagram of the mechanization is shown in 
Fig. 6, where Oya, Gyr; Tza, and gz, are the azimuth and 
elevation aim and rocket dispersions, respectively. 

The salvo begins with a pulse from the salvo pulse 
generator which selects a new aim point from noise gen- 
erators 2 and 4, triggers the sawtooth generator simulat- 
ing the linear aim point motion, and resets a flip-flop to 
respond to a possible hit recorded by the photocell. The 
output of the flip-flop, which can respond only once dur- 
ing the salvo, is counted by the “hit” counter. The num- 
ber of rockets in a salvo is determined by the relative 
frequencies of the “salvo” pulse generator and the 
“rocket” pulse generator which is connected to the in- 
tensity grid of the oscilloscope. 

A basic requirement in this simulation is that the in- 
dividual rocket dispersions be uncorrelated. In general, 
the noise bandwidth must be increased if this require- 
ment is to be met while increasing the rocket pulse rate 
and thus the computation rate. 

There is, however, an associated increase in the ve- 
locity of the spot on the oscilloscope screen. This 
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elongates the scintillations and effectively blurs the 
sharp boundaries of the mask. The length of a trace is 
simply vAt where v is the average spot velocity during a 
pulse length At. The minimum pulse length is generally 
determined by the response of the screen and is of the 
order of 4 usec depending on the operating conditions of 
the tube and the sensitivity of the photomultiplier. 

The amount of degradation in accuracy resulting 
from this effect is not easily estimated in general since it 
depends on the shape of the mask and the portion of a 
trace required to give a count. If the trace lengths are 
not significantly larger than a stationary spot, the ac- 
curacy will not be degraded. If such a requirement re- 
sults in too long a computation time, as determined from 
the following analysis, the effect of increased trace 
length can best be determined by observing the effect of 
increasing pulse lengths on a measured probability of 
hit. 

If a trace length v,,At is the maximum consistent with 
the resolution of the mask, the noise spectrum must be 
chosen such that the spot will appear on the screen with 
a velocity greater than v, only a small percentage of the 
time. 

An estimate of this requirement may be obtained by 
assuming a screen radius 7 with independent Gaussian 
sources of equal standard deviation o (inches) applied in 
the vertical and horizontal channels and centered on the 
screen. The probability of a trace appearing on the 
screen is 


1 = en? /20* 


and the probability of the spot velocity being greater 
than v,» is 


1 — [1 — em? /2007] = g-vm*/200? (26) 
where go, is the standard deviation of the velocity dis- 
tribution. Since the amplitude and velocity distributions 
are independent, the probability of a trace longer than 


v,»At appearing is 
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where ¢(r) is the autocorrelation function of the noise 
and it is assumed that > f?W(f)df exists. Then 


Pes Ym? |2k2o?| 4 = e771 120”) 


(29) 
In order to insure meeting the criterion, P may be de- 
termined for the worst o. Maximizing this function one 


finds 
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where 
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This function is plotted in Fig. 7. 

If a correlation of 0.1 for successive rockets is ac- 
ceptable and only one per cent of the traces have a 
velocity greater than v,, the allowable rocket pulse 
repetition frequency 1/to may be computed from the 
correlation function of the noise sources and the value 
k=v,,/6r obtained from Fig. 7. 

The two RC filters previously considered for which the 
rms velocity exists are compared under these conditions 
in Table II. Here it is also generally desirable to use a 
sharp cutoff frequency characteristic in the noise filter. 

When the maximum rocket pulse rate has been es- 
tablished, the accuracy depends on the sample size, 7.e., 
the number of salvos fired. The photocell output is sub- 
ject to additional filtering by the “at least one” circuit. 
However, the resulting probability distribution is that 
of (23) and the dispersion of the result may be obtained 
as a special case of (8). Since the results of the salvo 
firings are uncorrelated, 

ppt PHL Pa) Po 
N 
where WN is now the number of salvos. This result may 
also be obtained from a consideration of the binomial 
distribution of which this is an example. 
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Fig. 7—Maximum probability of a trace appearing inside 
a radius 7 and having a velocity >vm. 


An Experiment in Musical Composition* 
F. P. BROOKS, JR.t, A. L. HOPKINS, JR.t, P. G. NEUMANNI, anp W. V. WRIGHTt 


Summary—The high-order probabilities of element sequences 
can be determined from a sample of linear structures and can be 
used for synthesis of new structures. From theoretical considerations 
one can identify the qualitative conditions for satisfactory output. 
The theoretical concepts can be tested and quantitative parameters 
determined by experiment. Such an experiment has been performed 
by analyzing written music and by testing the analysis through the 
synthesis of new musical compositions, using a digital computer. 

A sample of 37 melodies was analyzed for the probabilities of the 
elements, element pairs (digrams), trigrams, and so on to the eighth 
order. The tables derived were used for the synthesis of original 
melodies by a random process. The theory and the experimental 
verification are considered in detail. The experimental results pre- 
sented include comparative statistics of the successful syntheses 
using each of the eight orders of analysis, examples of melodies 


* Manuscript received by the PGEC, April 20, 1957. 

+ Product Dev. Lab., International Business Machines Corp., 
Poughkeepsie, N. Y. Formerly with The Computation Lab., Harvard 
Univ., Cambridge, Mass. 

{ The Computation Lab., Harvard Univ., Cambridge, Mass. 


generated by low, medium, and high-order synthesis, and confirma- 
tion of degeneracy and other effects predicted by the theory. 


INTRODUCTION 
Valea thought processes have at least two 


radically different components, often identified 
as induction and deduction. Digital computers 
are readily programmed to perform deductive “reason- 
ing,” but their ability to draw generalizations from spe- 
cial cases is extremely limited. Many interesting com- 
puter experiments in game playing, “learning,” theorem 
proving, etc., have been aimed at discovering methods 
of simulating rudimentary inductive processes with a 
computing machine.!:? 
1 C, E. Shannon, “Computers and automata,” Proc. IRE, vol. 41, 
pp. 1234-1241; October, 1953. 


JIN ACE Oettinger, “Programming a digital computer to learn,” 
Phil. Mag., vol. 7, pp. 1243-1263; December, 1952. 
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There are often demands for inductive reasoning 
where the results of the generalization process do not 
need to be stated explicitly as rules but only need be ina 
form suitable for subsequent deductive reasoning. This 
is the case whenever one attempts to synthesize struc- 
tures of a certain class, as in the creation of synthetic 
linguistic utterances or synthetic musical compositions. 
The simplest way to perform such tasks is for a human 
to analyze some sample of the type of structure desired, 
draw up some explicit rules and constraints, and allow 
the machine to operate deductively, although perhaps 
at random, in the synthesis of new structures. Some 
workers have performed computer-implemented musical 
composition in this manner. 

It is of considerably more interest to attempt to 
synthesize musical compositions by having the machine 
inductively analyze a sample of acceptable compositions 
and, using its conclusions, deductively synthesize new 
but original compositions. Such an induction can be per- 
formed by determining the probabilities of note se- 
quences. Several theoretical aspects of such a process 
deserve examination. 


THEORY OF ANALYSIS-SYNTHESIS 


The derivation of sufficient information from a sam- 
ple to permit subsequent deductive synthesis of new and 
original members of the same class of structure depends 
not only upon the sophistication of the analysis, but 
also upon the characteristics of the sample analyzed. 
Suppose one undertakes to analyze a small number of 
tunes and to use the results in a random process for 
synthesizing new tunes. One can anticipate three causes 
of difficulty which can be visualized with the aid of 
the diagram in Fig. 1. This diagram shows that the 


Generalization 
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Fig. 1. 


process of analysis of several members of a sample 
Si, So,°-:-*, Sz, belonging to some common class of 
structure, yields a generalization G. From the general- 
ization, a synthesis is used to derive one or more new 
structures S’, which one hopes will be of the same class 
of structures as the original sample. The first difficulty 
is that overly naive analysis may yield a generalization 
so loose that the resulting S’ does not belong to the same 
class of structure as the sample members. For example, 
synthetic note sequences may not belong to the class of 
acceptable melodies from which they were derived. The 
second difficulty is that the sample may be so small that 
no generalization may be drawn no matter how sophisti- 
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catedly an analysis is performed. The third difficulty is 
that the sample members may be so alike that when the 
generalization is formed, it is impossible to create a new 
structure of the same class which is not identical to one 
of the structures of the sample. 

It appears worthwhile to perform some experiments 
to verify the existence of these three effects and to learn 
something about the basic nature of the analysis and 
synthesis process. For this purpose, two structure classes 
of interest are the class of linguistic utterances accepta- 
ble to human beings as “meaningful” and the class of 
musical compositions acceptable to human beings as 
something a human might have created. The synthetic 
linguistic utterance problem (which includes the well- 
known sonnet-writing problem) is more general, more 
interesting, and more difficult than the musical compo- 
sition problem. The musical composition problem, in- 
teresting in its own right, also serves as a small-scale 
model of the linguistic utterance problem. For these 
reasons the experiments described herein were under- 
taken on the application of the analysis-synthesis proc- 
ess to the musical composition model. 

The analysis of any structural system consists of the 
determination of a set of basic elements and the de- 
termination of the combinational relationships among 
the elements. For the present, we consider that only the 
second step is sufficiently difficult mechanically to be 
worth computer mechanization and sufficiently simple 
conceptually to permit computer mechanization. 

The constraints of combination of an element set can 
be stated in several different ways. The first of these is 
the explicit statement of rules as to what combinations 
may or may not occur. For example, the explicit method 
of representing linguistic constraints is illustrated by 
the schoolboy’s grammar and spelling books. Here one 
finds several specific examples of a connective pattern 
grouped together with the generalization from these to a 
rule: “2 before e, except after c, or when sounded as a, as 
in neighbor or weigh.” From the set of rules on spelling, 
the explicit method extends to the formulation of rules 
for the combination of larger elements in formal gram- 
mar, syntax, and rhetoric. The expression of all the 
combinational constraints in a structure by such a 
method may grow quite complex with many levels of 
rules, sub-rules, exception systems, and specific excep- 
tions. Examination of any complete grammar reveals 
this complexity at which the “i before e” example only 
hints. 

A second approach is the exhaustive one in which all 
the combinational constraints are listed explicitly. A 
class can always be completely described by listing its 
members, and this description is often more useful, more 
revealing, and less confusing than any set of class char- 
acteristics. We do, in fact, learn the constraints of com- 
bination for z and e by long and painful use of spelling 
book and dictionary which list all the extant combina- 
tions. By this means, our description of constraints ex- 
tends to seize and financier without any special treat- 
ment. While the exhaustive approach has the advantage 
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of conceptual simplicity and guarantees a complete de- 
scription of any structure, it is tedious and burdensome 
to apply to any system as complex as language or music. 

Both the explicit and the exhaustive methods of con- 
straint description are incomplete; they only indicate 
which combinations may occur without describing the 
relative frequency of occurrence. The mere statement 
that ¢ and e can each follow an initial p is incomplete 
without the information that p/- is much less common 
than pe-. This leads to a.third method of constraint de- 
scription, the probabilistic statement. 

The probabilistic description shares the advantages of 
the exhaustive description; it is simple in concept and 
uniform in application. Ease and certainty of determin- 
ing combinational constraints in analysis and following 
them in synthesis are independent of the complexity or 
obscurity of the constraints themselves. For computer 
application these are cardinal virtues, and the great 
magnitude of the task of formulating and applying such 
a description is a less important problem. The probabil- 
istic method has a further advantage over other methods: 
the precision and validity of the description are little 
affected by the inclusion or exclusion of sample mem- 
bers beyond a sample of a certain size. With both the 
explicit and the exhaustive methods, the existence of an 
exception not included in the sample analyzed would 
compromise the accuracy of the analysis. Finally, al- 
though analyses for some purposes are required to yield 
an explicit statement of the common properties of a 
sample, this is not required for the analysis-synthesis 
process shown in Fig. 1. 

For these reasons, the probabilistic method was chosen 
for the analysis-synthesis experiments described below. 
Analysis by probabilities of combinations may be taken 
to any order. One may use simple probabilities of oc- 
currence, simple transitional probabilities in a sequential, 
linear structure, or conditional probabilities depending 
upon any number of preceding or adjacent elements. 

The concept of using probabilistic analysis as part of 
an analysis-synthesis procedure is by no means new. 
Shannon?’ proposed a simple and elegant method of per- 
forming an implicit analysis and synthesis of linguistic 
utterances. Pinkerton* and F. and C. Altneave® have 
used simple transitional probabilities for the analysis 
and synthesis of melodies. 

The use of probabilistic descriptions of several orders, 
however, permits one to apply successively more sophisti- 
cated analytic procedures to a given sample in an at- 
tempt to determine the existence and behavior of the 
three hindering effects set forth earlier. This was the 
primary purpose of the experiments described below. It 
was an incidental but fervent hope that the sample 
selected would be sufficiently large and rich to permit 


3C, E. Shannon and W. Weaver, “The Mathematical Theory of 
Communication,” Univ. of Illinois Press, Urbana, Ill., pp. 11-15; 1949. 

4R.C. Pinkerton, “Information theory and melody,” Sci. Amer., 
vol. 194, p. 77; February, 1956. 

5 F. and C. Altneave, unpublished study described by H. Quastler, 
“London Symposium on Information Theory,” Butterworth, Ltd., 
London, England, pp. 168-169; September, 1955. 
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some of the more sophisticated analysis-synthesis pro- 
cedures to yield musical compositions that were both 
original and musically acceptable. 

For structures that are linear or one-dimensional, 
higher-order transitional probabilities are known as 
Markoff chains, and we shall refer to their determination 
as a Markoff analysts and their use in the construction of 
new structures as a Markoff synthesis. Let us examine in 
more detail the analytic and synthetic methods used. 


METHOD 


A Markoff analysis of order m is the process of de- 
termining certain joint probabilities of the occurrences 
of elements in a sample. Thus, within the sample, a 
given sequence of (m—1) elements may be followed by 
any one of several elements. We wish to find the relative 
frequency of each of these elements after the given 
(m—1) element sequence. A sequence of m elements will 
be called an m gram. A sample will ordinarily be made up 
of several independent sequences of elements called ut- 
terances. A step in a Markoff synthesis of order m is per- 
formed by choosing an element to follow a given ele- 
ment sequence of length (m—1) in such a way that, if 
this process were to be repeated a large number of 
times, the relative frequencies of the chosen elements 
would match those found in the sample. Since it is de- 
sired that the synthesis be random within these restric- 
tions, the choice is made according to the magnitude of 
a random or pseudo-random number. It is sufficient for 
this purpose, then, to construct for each element se- 
quence of length (m—1) a table of cumulative prob- 
abilities which allots to each mth element a segment of 
the range of numbers between zero and one, the size of 
the segment being the desired relative frequency of the 
note. Then a random number between zero and one falls 
into the range allotted to an element with a probability 
equal to the relative frequency of the element. This pro- 
cedure is, in effect, a mapping of a uniform distribution 
of random numbers into the nonuniform distribution of 
elements following a given sequence of (m—1) elements. 
Consider, for the sake of illustration, the following hy- 
pothetical fourth-order analysis and synthesis of musical 
text. Suppose that the occurrences of a three-note se- 
quence C— E—G in the sample are as shown below: 


Cae Ge ge 
Ce eG 
CIEE GaN 
Gi, 
i Be Gee 
CID a 
Owe) Ores 
Co GG 
Ca a Gy 
Cy ae mr 
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The relative frequencies of notes following the sequence 
C—E—G are: 


A 2/10 = 0.2 
C 1/10= 01 
E 2/10 = 0.2 
G 5/10 = 0.5. 


Synthesis may then be carried out by means of the table 
of cumulative probabilities which, for any argument, x, 
between zero and one, will determine the note to be 
selected. One of the several possible arrangements of 
such a table is: 


A (ise OFZ 
CEO eer O15 
PiU BES (He OS 
GAe. dps 120; 


If the random numbers x are uniformly distributed be- 
tween zero and one, the probability of choosing a C is 
one tenth; and in the course of synthesis, the sequence 
C—E—G will be followed by C with expectation of oc- 
currence of one tenth. Clearly, the conditional prob- 
abilities found by Markoff analysis can be approxi- 
mated to any desired accuracy by this method. 

The three hindering effects considered above can be 
understood more precisely in terms of the Markoff 
analysis and synthesis method. The first effect, overly 
naive analysis, will show itself when only low-order 
transition probabilities are used, so that the structure of 
the synthetic composition is insufficiently constrained. 
This permits the occurrence of note sequences that are 
not acceptable as legitimate musical structures. 

The second effect, insufficient sample size, shows it- 
self at some order m of analysis and synthesis where 
each distinct m gram occurs only once. From that order 
upward, further analysis is useless since the higher-order 
transition probabilities are completely determined by 
the analysis to that point. There is no more information 
to be extracted from the sample. Therefore, if the syn- 
thesis at this order fails to yield acceptable and original 
utterances, nothing can be done, for the sample size is so 
small that further sophistication of the analysis yields 
no benefits. 

The third effect, insufficient sample diversity, will 
always show itself before or at the same time as the 
second effect, and so is of much greater practical im- 
portance. Suppose the digrams occurring in the sample 
have been found, and a trigram analysis is performed 
yielding one distinct trigram for each distinct digram. 
Even though there may be many occurrences of each 
digram and thus of its associated trigrams, an utterance 
is completely specified by giving the initial digram, for it 
will specify a trigram whose final two elements uniquely 
specify another, etc. Further sophistication of the analy- 
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sis is fruitless beyond this point; all the information in 
the sample has been extracted. If the analysis to this 
order is insufficient to yield acceptable and original 
utterances, nothing can be done; the sample is too re- 
dundant to yield more information. 

From the theoretical examination of the analysis- 
synthesis problem, one can see that experiments using 
Markoff analysis and synthesis will yield any of three 
results. If too elementary or low-order analysis is used, 
the results will not resemble the sample members 
closely enough to be recognized as members of the same 
class. If too high an order of analysis is attempted for a 
given sample size and diversity, the synthesized results 
will degenerate; that is, they will duplicate sample 
members. Or, if the sample is sufficiently large and di- 
verse, there will be some orders of analysis for which the 
results are original and still recognizable as members of 
the class. 

For the sample of music selected, each of the three 
results was found for some order of the Markoff analysis- 
synthesis. 


THe EXPERIMENTS 


As indicated above, both linguistic utterances and 
musical compositions are interesting structure classes 
upon which to perform experiments in Markoff analysis 
and synthesis; the musical structures were chosen be- 
cause of the greater simplicity. The selection of music 
did introduce problems, however. Music has many di- 
mensions, such as pitch, meter, rhythm, key, harmony, 
dynamics, and quality. Some selection must be made as 
to which to include as experimental variables and which 
to ignore. Since quality is not expressed in written 
music, and difference in key can be grossly compensated 
by transposition, these were not treated as variables. 
Harmony introduces a vertical as well as a horizontal 
structure to the text, and the need for simplicity dic- 
tated that the present experiments be confined to the 
horizontal structure of a single line. The metrical struc- 
ture was fixed as an experimental variable by using a 
sample all of whose members had a fixed metrical struc- 
ture. 

After written music was chosen as the structure class 
to be used in the experiments, a sample was assembled. 
It consisted of 37 common meter hymn tunes, a choice 
determined largely by the decision to work within one 
metrical structure. The common meter hymn is perhaps 
the most widely used rigid metrical structure and one 
of the simplest. In fact, several variants are found even 
within this structure, and the sample was confined to the 
most common single variant. The common meter hymn 
tune has the additional advantage of providing a fairly 
large collection of compositions from different composers 
and centuries of origin. The hymns in the sample all be- 
gin on the last beat of a four-beat measure, and none 
have any notes shorter than an eighth note. 

Several analyses of the sample and syntheses of new 
hymn melodies were performed with a large-scale com- 
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puter. The machine has random-access storage of 230 
sixteen-decimal digit numbers and separate magnetic 
drum storage of 4000 numbers and 10,000 instructions. 
It is synchronous in operation with most instructions 
requiring 1.3 usec. 

For computer manipulation it was necessary to en- 
code the notes as numbers. A range of four octaves in 
the chromatic scale was selected, and each tone was 
assigned a two-digit number. Different time values were 
represented by dividing the whole hymn into 64 eighth- 
note cells. The content of each cell was either a tone 
struck in that cell or one held over from the preceding 
cell. The even integers from 02 to 98 were used to repre- 
sent a struck tone while the corresponding odd integers 
from 03 to 99 were used to represent a continued tone. 
Henceforth, each of the eighth-note cells will be re- 
ferred to as a note regardless of whether it represents 
a struck or a held note. In order to provide a common 
basis for the analysis, each hymn was transposed up- 
wards to the nearest key of C. 

As each storage location was capable of holding six- 
teen decimal digits and hence eight notes, it was con- 
venient to carry out analyses up to the eighth order. As 
it turned out, this order was the one at which re- 
dundancy-caused degeneracy became noticeable. 

The first step in the analysis was to isolate all of the 
eight-note sequences or octograms occurring in the 
sample, and then sort them into numerical order.® 

This sort placed all of the octograms in order within 
their initial heptagram, all heptagrams in order within 
their initial hexagrams, and so on. Hence, the sorted 
sequences of lower orders were readily obtainable from 
the sorted octograms by shifting all the octograms the 
appropriate number of places to the right, thus eliminat- 
ing the extraneous notes. 

To complete the analysis, cumulative relative fre- 
quency tables of the type previously discussed were 
formed for each value of m for all of the (m—1)-note se- 
quences present in the sample. The relative frequency 
for each distinct m-gram was calculated directly from 
the sorted m-grams by counting the number of occur- 
rences of the m-gram. This number; 7.e., the number of 
times the mth note followed the initial sequence of 
(m—1) notes, was divided by the total number of oc- 
currences of all m-grams having the same initial (m—1)- 
note sequence, thus giving the relative frequency of the 
mth note with respect to that initial sequence. The 
entries in the table were calculated by accumulating the 
relative frequencies pertaining to the same (m—1)-note 
sequence. 

As an illustration of this procedure, consider the hy- 
pothetical sequence of sorted octograms shown in 
Table I. The resulting octogram table entries are the 


6 The sort was performed by a general purpose digital sorting 
routine that counts digital occurrences in the (7-++-1)st column while 
sorting on the mth column. Rapid and efficient in use of storage, the 
routine sorts up to 2000 numbers without requiring any intermediate 
input or output. The authors are indebted to A. S. Goble III and 
J. Hines for the programming of the routine. 
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TABLE I 


SORTED OCTOGRAMS, ILLUSTRATING THE FORMATION OF THE 
CUMULATIVE PROBABILITY TABLES 


Cell Octo- | Hepta-} Relative | Cumula- 

€ gram | gram Fre- tive 
12 3 4 5 6 7 8 | Count | Count | quency |Probability 
30537.26 2%) 32) 33°26 22 1 
“EXO Sil Xa) PP SY) BS AAS 172 2 2/8 2/8 
0 SAD FL BPS. AO AY 1 
36) 37220 27-32" 33 26, 27. 2} 
36).34020 21932)33;) 26 27 3 
Sp eil DADO CVF 33) PXoy 27) 4 
*3OnGieZ OMe ROLE OO) LOmaT 5 5/8 7/8 
7303/2720) 2132133) 20 28 1 8 1/8 8/8 
$6-37 20-27 32) 33132 33 1 
RO Se LA) PE SRY SE 2 2 2/2 2/2 
SSONSIMOZEOOROD) COL S2T oS 1 1 1/1 1/1 
SORSIMOZNOSH OLE SESONST 1 
SS ONS IROLES GRO LESS TOOP Sd 2 2/3 2/3 
“3 0uS/ S2OONS2U 05, CORL2 1 3 1/3 3/3 


distinct octograms (denoted with an asterisk) and their 
associated cumulative probabilities, shown in the last 
column. The octogram 3637 2627 3233 2622 corresponds 
to the eight-note sequence GGCCAACD, where a bar 
over a letter indicates that the note is held. 

For each m the number of these tables was equal to 
the number of distinct (m—1)-grams. Table II, next 
page, gives the total number of m-grams beginning with 
struck notes, held notes, and initial rests (00). With 64 
octograms in each hymn, the 37 hymns yielded 2368 
octograms. As seen from the table, only 1701 of these 
were distinct. Since the number of distinct heptagrams 
was 1531, there were exactly that many octogram tables 
having 1701 entries in all. The 4000-word drum storage 
of the computer thus sufficed for the storage of both the 
sorted distinct octograms and their associated cumula- 
tive probabilities. 


THE SYNTHESIS 


Syntheses of orders one through eight were then ac- 
complished by the process of Markoff synthesis dis- 
cussed earlier, using eight digit pseudo-random num- 
bers obtained from an algorithm known to be non- 
repetitive for the first (108+1)/17 numbers.’ The first 
note of the hymn was found by entering the probability 
table for the m-grams whose first (m—1) notes were rests 
and choosing at random among these. The second note 
was selected by choosing an m-gram beginning with 
(m—2) rests followed by the first chosen note. The pro- 
cedure of choosing one m-gram, given the preceding 
(m—1) notes, was carried on in similar fashion until the 
64 notes comprising one hymn had been generated. The 
encoding of initial rests preceding each hymn thus per- 


7D. H. Lehmer, “Mathematical Methods in Large-Scale Com- 
puting Units,” Proceedings of a Second Symposium on Large-Scale 
Digital Calculating Machinery (1949), Harvard Univ. Press, Cam- 
bridge, Mass.; 1951. 
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TABLE II 
Distinct M-Gram Counts, BEGINNING WITH SEVERAL DIF- 
FERENT NOTES 


Initial 
Note 


Order of Analysis m 


1 2 3 4 5 6 7 8 
19> Ges 1 Set 2D a Oe OO 99 — 102 
13 G 1 12 30 67 — 84 124 - 131 150 
(oma 1 6 14 25 43 - 45 63 - 63 
17 PF il S432 SS 51 = 51 66 
OY YB 1 6. 192 32 F 74a aso Meike Akl 
19 E 1 11 23 68 - 78 130 -— 135 156 
D2) ee 1 4 19 30 66- 69 £104 — 109 
23 D 1 125 21 eS = G41 O25—= 1 068m 26 
Xe ACs ass 1 ae AS Gr Al al Se 
27 (GE (ei See 255 Oe omer See 6 
All Struck 18 47 152 219 444-479 698 — 705 
Notes 
All Held 18 110 182 428 -485 717 - 738 869 
Notes 
00 Initial 1 Se 102845 70 95 127 
Rest 
Total Distinct S/mLO2N O44 e015 mo (4a OOM DOLE U7 On 
m-Grams 


mitted the synthesis process to operate uniformly, even 
in starting. 

The selection of notes was subject to certain exter- 
nally applied constraints in addition to those implicit in 
the frequency tables of the analysis. These explicit con- 
straints, however, were just those permitted by the se- 
lection of a sample of uniform metrical structures. In 
order to force the synthesis to stay within the selected 
metrical structure, a metric constraint was applied to 
certain critical notes. For example, the first note of each 
measure had to be struck rather than held. In addition, 
the two main phrases both had to end on a dotted half 
note; hence notes 28 through 32 and 60 through 64 were 
constrained to be held notes. Each note generated was 
examined and compared with the metric constraint, if 
any, for its position in the time basis. If the constraint 
was not met, the note was rejected and another note 
was generated by the next random number. If the con- 
straint could not be met after 15 trials, the hymn was 
discarded and a new one begun. Using these metri- 
cal constraints in this manner can be shown to be 
equivalent to determining and using separate note com- 
bination constraint tables for each time point or for 
subsets of the time points. The rigid metrical structure 
represented by the sample permitted the separation of 
metrical constraints from others with a considerable 
resultant simplification. 

An additional constraint was added in the last meas- 
sure of the hymn. Since after transposition all of the 
hymns in the sample ended in C above middle C, every 
generated hymn was required to end the same way. If, 
after fifteen trials, no final m-gram was chosen which led 
into a dotted half note C above middle C, the first 57 
notes already generated were used to begin another syn- 
thesis. This device distorted the absolute size of the 
yield percentages (number of acceptable hymns com- 
pleted over the number of starts). It did not, however, 
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TABLE III 
PERCENTAGE OF ATTEMPTS YIELDING ACCEPTABLE HYMNS 
Metre Order of Analysis m ‘ 
Constraint 1 2 3 fi 5 Ka ay 8 
Even Quarters 100 | 40 SVar el (D ete SVR) Sie 2265) 8.4 
Quarters with 
Various Options 41 Poy |jalss 11 2 10 
Dotted LOOMetS08 9S 2 1 0 0 0 
Dotted with 
Various Options | 100 | 17 4 ibe S| 0) 0 0 0) 
Skeleton 100 5 4 RYE A did) 
TABLE IV 


EXAMPLE OF M/-GRAM EXTENSION PROPERTIES 


Note m-Gram, Begun m-Gram, Begun 
ts Brought in with Struck Note with Held Note 
4 E CZERD ED), C DDE 
5 E CSG DDL EA aC. DD sia 
6 F GC CLD DIE. Ee GD DE tvs 


affect the faithfulness with which synthesized hymns 
obeyed all combination probabilities, nor should it have 
affected the relative sizes of the yield percentages as 
metric constraint or analysis order changed. Its use per- 
mitted the production of a significant number of accept- 
able tunes within a reasonable time. 


RESULTS AND CONCLUSIONS 


The synthesis just discussed was carried out with 
various metric constraints for all values of m from one 
to eight. The constraints were of three types. One of 
these types was based on even quarter notes throughout 
the hymn, except during the phrase ends. A second was 
based on a dotted rhythm in the second and sixth meas- 
ures. Both of these constraints were varied by the intro- 
duction of optional rhythms. The third type was a 
skeletal constraint requiring only that the first and 
seventh cells in each measure contain struck notes and 
that the two main phrases end as usual, leaving the re- 
maining rhythmic structure optional. 

In all, over 600 complete hymns were synthesized in 
some 6000 starts. In cases where the yield was a very 
low percentage of the number started, more attempts 
were made than in cases where the yield was high. A 
summary of the results is shown in Table III, which 
gives the yield for each order m under the various con- 
straints. 

The yield is the percentage of the completed hymns 
out of the total number started. In particular, the simi- 
larities between the yields for orders four and five and 
between the yields for orders six and seven are worthy of 
comment since they resemble those between the distinct 
m gram counts in Table II. As predicted from theoretical 
considerations, the transition from an odd m to the next 
higher (even) m introduces more implicit constraints 
than does going from an even m to the next higher (odd) 
m because of the basic quarter-note structure. Thus, 
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TABLE V 
Metric CONSTRAINTS OF EXAMPLES 1-5 

1p i x — X —O X XK — X X xX xe xX xX xX X X X X —XX | KX ————— 
Ex. 2 Se eee a Cre Ke KN HOT ING RAUKN sot eae ee 
Ex. 3 ee eC eee a X OX Kiera VPS as LS ae 
Ex. 4 SR HG eaten cass case ies oe Xa SX eS be Xs ee rae 
xen xX O XO = OOP OmOs xe, © Ke OR On On On Ors .O Xe O (ONO OF ORGO xX SS 
t; t-32 ve Sy eS Soper OO eet oe LOml mks, LOP20 2223354220 DlaZouZo CGOLSES2 
Legend X Struck Note — Held Note O Optional: Struck or Held 


while the (2m—2)-gram and the (2m—1)-gram extend 
across at most m quarter notes, the (2m)-gram and the 
(2m-+1)-gram each extend across at most (m+1) quar- 
ter notes. Examples of this phenomenon are shown in 
Table IV, while the counts of m-grams in Table II, hav- 
ing similar extension properties, are joined with dashes. 

The synthesis for m=1 is random, obeying the (mono- 
gram) probability distribution. Any generated held note 
was interpreted as a continuation of the preceding 
struck note. A monogram hymn is given in Example 1 
(right). The particular constraint used for this hymn is 
shown in Table V, along with constraints for the follow- 
ing examples. The low probability of accidentals (sharps 
and flats) in the sample, less than one per cent, resulted 
in the presence of only one accidental in Example 1: the 
E flat for the forty-third and forty-fourth notes. Despite 
this, however, the hymn is not easy to sing and contains 
unnatural intervals. 

The digram hymn given as Example 2 exhibits several 
interesting irregularities. The constraint is a dotted con- 
straint with two optional eighths (see Table V). Al- 
though the trigram G F G exists nowhere in the sample, 
this combination appears twice in the example as indi- 
cated by the brackets. In both cases, the optional cell 
contains the struck note F even though the held note G 
is much more likely to follow the G. Finally, nowhere in 
the sample does a G precede a C dotted half at the end 
of a phrase, nor does a second phrase begin on F after 
the first phrase ends on C. Indeed, none of these features 
are in keeping with the usual explicit rules of compo- 
sition, but they are permitted by the inadequacy of the 
low order of the analysis-synthesis. 

In the syntheses of orders 4 and 5, there is less 
roughness of the generated hymn. A tetragram hymn 
with no options in the metric constraint (Table V) is 
shown as Example 3. The problem of excessive range is 
one which was introduced implicitly by the naive 
method of transposition. Most of the original hymns 
had melodic lines with a range of about an octave, but 
the transpositions spread these ranges away from the 
normal vocal range. 

The tetragram hymn illustrates a subtle manifesta- 
tion of the first synthesis hindering effect, one that was 
not anticipated. In syntheses of intermediate order, 
there were long ascending or descending sequences each 
made up of a succession of the short ascents or descents 
so common in the sample. With higher-order procedures, 
these overlong sequences cannot occur. 


Example 1 (m=4) 


—S sea SS 


jee See Soe 
SSS 


Example 3 (m=4) 


a 
pa 


Example 4 (m=6) 


= Se 
eS 


Example 5 (m=8) 


In Table III it is seen that the yield with m=7 repre- 
sents a minimum for each constraint and that the yield 
with m=6 is quite near this minimum. A hexagram 
hymn generated with a basic quarter-note constraint is 
given in Example 4. This hymn demonstrates the exist- 
ence of the “middle ground,” and nowhere contains 
more than four consecutive quarter notes of any hymn 
in the sample. It shows the long-descent effect to some 
degree. 

The yield for m=8 in Table III is appreciably greater 
than the yield for m=7. An examination of the octo- 
gram hymns reveals that a few of them are wholly 
identical with hymns in the sample. Several others have 
the entire first phrase of one hymn in the sample and the 
entire second phrase of another. An output hymn of 
order eight, which is an interesting composite of three 
hymns, is given as Example 5. The constraint is of the 
skeletal type and is shown in Table V. The seven-note 
section in brackets is common to two hymns at the seg- 
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ments and permits the changing of hymns in midphrase 
in this otherwise degenerate case. In a large number of 
output hymns in which such segmentation occurs, the 
transition preserves the absolute time coordinate of the 
original hymn. This was not true for orders lower than 
the eighth. Hence, at the eighth order, the third synthe- 
sis-hindering effect originally predicted has appeared. 
The sample is so redundant that the synthesis will not 
yield “original” utterances when carried out beyond the 
eighth order. 

The skeletal constraint managed to produce a greater 
yield than the quarter note constraint for m=8. On the 
lower orders of synthesis (m=4 and 5), the former con- 
straint permitted the hymn to run so astray that it 
could not meet a subsequent constraint. It hence pro- 
duced fewer acceptable hymns than the quarter-note 
constraint. For m=8, however, the implicit structures 
revealed by the octogram analysis were strong enough 
to keep the synthesis within the framework of the sample, 
thus producing mostly hymns of which each half was 
exactly like half of a sample hymn. This is a further re- 
sult of degeneracy. 


EXTENSION 


The present experiments have permitted the identifi- 
cation and characterization of the limiting effects that 
apply to any generalized analysis and synthesis, any in- 
duction and subsequent deduction. Since these processes 
will become more and more important in the application 
of computing machinery to more delicate and sophisti- 
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cated tasks, it is desirable to explore their character- 
istics and properties more fully. It is important to de- 
velop some measure of structural complexity in terms of 
information content, to develop better ways of charac- 
terizing the extent of limitation imposed by constraints, 
and to develop methods of describing the information 
content of a sample which is sufficient to permit syn- 
thesis of original members of some structure class. 

Ideally, the present experiments would not have been 
needed. One would have described the information con- 
tent of the sample and the extent of the constraints of 
the musical structure, and from this one could have pre- 
dicted that first and second-order Markoff analysis- 
synthesis would have yielded sequences unacceptable as 
hymns and that eighth order analysis-synthesis would 
have yielded sample members. 

The wide discrepancy between the ideal situation and 
that which currently prevails emphasizes the large 
amount of theoretical and experimental work which will 
have to be done before the inductive-deductive processes 
are well enough understood for general use in computing 
machine applications. 
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An Electronic Analog Cross Correlator for Dip Logs’ 
J. H. SASSEEN} 


Summary—The Dip-Log Correlator is a special purpose elec- 
tronic analog computer which rapidly cross correlates the three 
variable functions of a dip-meter well log. This cross correlator 
utilizes a novel derivation and application of the cross-correlation 
function from information theory. A prerequisite of the system is the 
recording of the dip-meter data on magnetic tape for computation 
by the cross correlator. The triple cross-correlation technique and 
some of the essential circuitry of the cross correlator which is in 
operation as a geophysical tool at the Humble Oil & Refining Com- 
pany Houston Research Center are described. 


INTRODUCTION 
vances in the broad field of communications are the 


outgrowth of information theory studies. Informa- 
tion theory is a fundamental mathematical study of the 


le recent years, some of the most important ad- 


* Manuscript received by the PGEC, April 28, 1957. 
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nature of information. It is considerably involved with 
statistical theory. Among other things, information 
theory has been applied to radio communication, radar, 
acoustics, meteorology, and even economics. 

Among the most useful tools from information theory 
are the correlation functions. These functions are ap- 
plicable to the data obtained from dip-meter well sur- 
veys since the computations involving these data call 
for recognizing the similarity of events between the 
three dip-meter functions and determining their “best 
fit” by relative shifts with respect to each other. Be- 
cause these data are collected and presented in an ana- 
log form, an electronic analog computer seems logical for 
performing these correlation operations. 

Dip-meter well logging or surveying involves meas- 
urements from a bore hole in the earth such that the dip 
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Fig. 1. 


magnitude and direction (with respect to true north) of 
a bedding plane or formation in the earth may be calcu- 
lated. The measurements involved may be of any physi- 
cal property which varies from formation to formation 
such as resistivity, self-potential, or bore-hole radius. 
The selected property is measured independently along 
three separate vertical paths. These paths are spaced 
120° apart and extend the entire length of the bore hole 
(Fig. 1). As the dip-meter device is drawn up the bore 
hole by means of an electrical cable, three arms carrying 
the measuring devices are pressed against the walls of 
the bore hole enabling the formation characteristics to 
be recorded at the surface. Thus, three curves are pro- 
duced as illustrated. Results depend to a large extent 
upon a break or change occurring at the formation 
boundaries. The apparent dip of a bed or formation may 
be calculated by measuring the displacement between 
similar events or breaks on these three curves in terms 
of bore-hole distance. In order to obtain the true dip 
magnitude and direction, the hole diameter, the amount 
and direction of hole inclination, and the direction of one 
of the measuring arms with respect to north must be 
known. This information is also continuously recorded 
by the dip meter. 

The difficult problem in dip computation is the corre- 
lating or picking of these breaks in order to determine 
the relative displacements between the measured dip- 
log data. These data vary in quality from good or highly 
coherent information, as shown, to poor or slightly co- 
herent. In general, the data are not as coherent as those 
which are shown and the human computer has trouble 
in correlating the data. It is also evident that the corre- 
lation of the data by a human computer is a highly 
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subjective process. For this reason, results are likely to 
vary widely from one computer to another, particularly 
when the data are poor. An electronic analog cross 
correlator has been designed and constructed to aid the 
human computer in correlating the three curves of dip- 
meter well surveys. 


Cross-CORRELATION FUNCTIONS 


The dip-log cross correlator operates on the three 
dip-log curves and performs the mathematical equiva- 
lent of a triple cross-correlation function. Let us con- 
sider the method of cross correlating only two functions 
of a common independent variable (Fig. 2). Illustrated 
are two dip-log data functions of the common inde- 
pendent variable, bore-hole depth, an equation for the 
cross correlation of two functions, and the cross-correla- 
tion curve which shows the degree of statistical simi- 
larity existing between the two functions. In essence, the 
equation states: take the average of the product of the 
two functions, for the interval —7T to +7, with the 
two functions displaced or shifted by an amount Tr. 
(Actually, the equation calls for the average over the 
interval minus infinity to plus infinity. In practice, of 
course, an approximation is necessary.) This procedure 
is carried out for all r’s or displacements along the inde- 
pendent variable axis, and the resulting correlation 
curve is plotted. The maximum on this curve represents 
the point of optimum correlation. The dip-log cross cor- 
relator obtains and combines the cross-correlation 
curves of the three possible pairs of the three dip-log 
data functions; that is, 


$1,2,3(0, 7) = $1 2(0) + dia(7) + $2 3(7 — o) 


where a is the distance that data function f2(.S) is shifted 
with respect to fi(S) and 7 is the distance that data 
function f3(S) is shifted with respect to fi(S). In the 
above equation, 


1,2(0) = filS)fo(S + 0) 
$1,3(7) Ii (S)f3(S + 7) 
$2,3(7 — a) fo(S + o)f3(S + 7). 


I 
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The dip-log cross correlator obtains the sum of the cross 
products and thus the triple cross-correlation function 
$1,2,3(0, T) in a rather simple way. Consider the expres- 


sion 


[A(S) + falS + 0) + falS + 7) 7? 


This expression when expanded results in a sum of terms 
as follows: 


2 i(S)folS + 0) + 2fi(S)fa(S + 7) + 2fe(S)fs(S + 7 — 0) 
+ fi(S)? + fo(S + 0)? + fa(S + 7)? 


It may be seen that the sum of the first three terms re- 
sults in an expression which is proportional to the triple 
cross-correlation function $1,2,3(¢, 7); in addition, there 
are three squared terms which are undesired. Each of 
these squared terms represents the mean power con- 
tained in the data functions f), fe, and f3, respectively. If 
a sufficiently long statistical sample is taken, then these 
squared terms will not be functions of o or 7, and conse- 
quently, the sum of the three terms may be considered 
constant. Thus the variable portion of the above ex- 


pression is proportional to the desired triple cross-corre- 
lation function $1,2,3(¢, T). 

It is evident that the electronic analog section of the 
correlator need only shift two of the data functions in- 
dependently with respect to the third and add the three 
data functions, square this sum, and then obtain the 
average over a suitable interval. In the correlation proc- 
ess of the correlator, the squared terms are held equal 
and constant, for all practical purposes, and are taken 
into account in calculating the correlation index. The 
dip-log cross correlator does not plot the surface or 
family of curves generated by the triple cross-correla- 
tion function ¢;,2,3(¢, 7), since the entire surface is not 
required and to do so would slow up the operation. Only 
the value of ¢ and7z at the maximum or peak correlation 
is required, and a meter is used to indicate this maxi- 
mum. 


Dipe-LoG Cross-CORRELATOR EQUIPMENT 


A prerequisite of the correlator system is the record- 
ing of the dip-meter data on magnetic tape for computa- 
tion by the cross correlator. The magnetic-tape equip- 
ment for recording dip-meter signals in the field consists 
of a set of recorder electronics, its power supply, and a 
14-track magnetic-tape transport (Fig. 3). This record- 
ing system connects into the output circuits of any of the 
conventional dip-meter loggers. The recorder electronics 
is a direct recording system which essentially consists of 
a 3.5-kc bias oscillator and three push-pull dc amplifiers 
for the dip-meter signals. This 3.5-kc bias and the dip- 
meter signals are added together in the 50-mh center- 
tapped magnetic record heads. Also included in the 
recorder unit is a pulse system for recording depth-mark 
pulses and pulse-type orientation data (hole inclination, 
its direction, etc.). The magnetic-tape transport utilizes 
tape that is one inch wide. This magnetic tape is driven 
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Fig. 3. 


by a selsyn system which follows the movement of the 
logging cable. A one-foot movement of the logging cable 
results in six-hundredths of an inch of magnetic-tape 
movement; thus, at a logging rate of 60 feet per minute, 
the tape speed is six-hundredths of an inch per second. 
Hence, only 50 feet of tape is required to log a 10,000- 
foot well. This contrasts with the 1000 feet of paper or 
film for the usual visual record. The dip-meter magnetic- 
tape recording is brought in from the field to the dip-log 
cross correlator to be computed. 

The dip-log cross correlator is composed of a number 
of units. Fig. 4 is a simplified block diagram of the 
equipment. Essentially, two operations are performed: 
first, the three channels of dip-log data are simultane- 
ously transcribed section by section from the field mag- 
netic-tape recording onto the magnetic storage drum; 
next, these data are correlated by means of the elec- 
tronic analog computer. The playback of the signals for 
transcription is performed at constant tape speed; there- 
fore, time becomes the analog of depth in the system. 
This playback speed is about 1000 times faster than the 
speed at which the signals were recorded, and hence all 
recorded frequencies are projected upwards a thousand- 
fold. In other words, at a logging rate of about 60 feet 
per minute, a 45-cps signal becomes 45 kc, the upper 
frequency limit of the system, and a 0.25-cps signal be- 
comes 250 cps, the lower frequency limit of the system. 
The transcription process for the signals from the tape 
to the magnetic storage drum is also a direct-recording 
system. In order to transcribe data to the drum, the 
correlator operator sets a number into the preset 
counter corresponding to the starting depth of the data 
to be correlated. Then, a cycling button is pressed, 
which automatically initiates a series of events as fol- 
lows. First, any previous signals on the storage drum are 
erased. Second, the tape-transport mechanism starts 
and comes up to the speed of 60 inches per second. 
Third, the counter counts depth pulses until the preset 
count is reached, at which .time the transcription- 
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Fig. 4—Office transcription and correlation equipment. 


amplifier gates are opened, allowing data to flow from 
the tape to the drum. After one complete revolution of 
the drum, the gates are closed and the drum contains 
100 feet of dip-meter data. Actually, about 113 feet are 
recorded to allow leeway in gating. Fourth, after the 
section of data has been recorded, the tape transport 
automatically reverses and rewinds to the beginning of 
the record where it stops, ready for the next transcrip- 
tion cycle. The tape is stopped after rewind by means of 
a photocell circuit, which is actuated by an appropri- 
ately placed hole in the magnetic tape. This hole is pre- 
viously punched ahead of the actual data on the tape 
to allow the tape to accelerate to full speed before the 
data are encountered. This transcription cycle requires 
about eight seconds on the average. However, it is not 
necessary for the operator to wait this entire time before 
starting to correlate the data, since part of the eight 
seconds is consumed in rewinding the tape after the data 
have been transcribed. A complete transcription circuit 
consists of a preamplifier, an equalization network, a 
constant-current output stage, and a bias oscillator with 
its power-amplifier stage. 

With signals on the high-speed magnetic drum, the 
major electronic steps in the cross-correlation process 
are then as follows. First, the electrical signals from the 
three dip-log data channels on the drum pass to three 
preamplifiers and thence to an adding circuit. From this 
point on, only one channel is required. Second, the re- 
sulting signal is then equalized to compensate for the 
frequency response characteristics of the playback head 
and drum. Third, the signal next passes through the 
gating relay which is cycled by the pulse and gate cir- 
cuit in accordance with the setting of the gating heads 
which are mounted around the drum. Fourth, the sig- 
nals pass to a power amplifier and then to a squaring and 
averaging circuit. This squaring and averaging opera- 
tion is carried out by means of vacuum-type thermo- 
couples. Fifth, the output of these thermocouples is then 
amplified by means of a chopper stabilized dc amplifier 
and indicated by a meter, 
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One of the major units of the correlator is the mag- 
netic drum which provides a storage medium for the 
computer (Fig. 5). This ten-inch-diameter drum is 
turned about 530 rpm or 280 ips and utilizes magnetic 
heads which are spaced away from the drum by ap- 
proximately 0.0008 inch. Nonferrous materials were 
used as much as possible in the construction of the drum 
housing. The drum is made of an aluminum alloy forging 
and it is mounted on precision bearings which have very 
small eccentricities. The final cut on the drum surface 
was made with the drum turning on these bearings. The 
outage of the drum is less than +50 microinches. The 
three-inch-wide drum was then very uniformly sprayed 
with many coats of magnetic oxide, the final coating 
thickness being less than one-thousandth of an inch. 
Four types of magnetic heads are used on the drum— 
dip-log data record heads, dip-log data playback heads, 
pulse record heads, and pulse playback heads. The 
erasure of each track is accomplished by using the rec- 
ord heads as erase heads. The pulse channels are erased 
with dc, while the dip-log data channels are erased with 
a 150-ke signal. Considerable ac power is required for 
erasure at 150 kc because of the core losses in the mag- 
netic heads. This ac power is permitted to flow to the 
heads for only about 0.3 second—just long enough to 
allow the drum to rotate about three times. Thus, the 
heating of the heads is kept to a minimum. 

Two of the three dip-log playback heads are movable. 
Each of these heads is attached to a micrometer barrel 
for movement around the periphery of the drum. The 
heads can be moved plus or minus one-half an inch, 
which corresponds to a plus or minus 20-inch vertical 
displacement of the dip-log data curves in the bore hole. 
A calibrated indicator also attached to the micrometer 
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Fig. 6—Thermocouple protective circuit. 


provides a direct reading of the equivalent vertical dis- 
placement of the dip-logging measuring device in incre- 
ments of four-hundredths of an inch. Two of the pulse 
playback heads are movable through about 330° of the 
drum periphery, and their setting determines the gated 
fraction of the 100 feet of data. These heads may be 
moved independently, or they may be moved as a pair 
around the drum. This is accomplished by means of a 
clutch and gear box that drive the ring gears to which 
these pulse heads are attached. Scales are provided for 
reading the number of feet in the interval being gated 
for correlation and for location of this interval in the 
100 feet of data on the drum. 

One of the most interesting electronic circuits of the 
cross correlator is the squaring and averaging circuit 
(Fig. 6). The squaring and averaging is accomplished by 
means of vacuum-type thermocouples which are pro- 
tected from “burn-out” by the associated protective 
circuit. Some power is required to drive the thermo- 
couples, and this is furnished by a power-amplifier stage 
that is capable of about 10 to 12-w peak power. The 
rated average power for the four thermocouples is about 
16 milliwatts. The 10 to 12-w peak power capability of 
the power amplifier is necessary because of the extremely 
high peak-to-average power ratio of the gated dip-meter 
signals. This ratio can run as high as 3000 to 1 under 
extreme conditions. Thermocouples square and average 
quite well in spite of the high peak-to-average power 
demand, since their action is independent of peak val- 
ues. Also, the thermocouples’ squaring action is almost 
perfect. The thermocouples are operated at an average 
power level of about 1 milliwatt or less in order to al- 
low for high peak-to-average power ratios and to pro- 
vide a “burn-out” safety factor. Since the thermo- 
couples will only tolerate a relatively small overload, 
they have been provided with a protective circuit. This 
circuit uses a crystal-diode power monitor which con- 
tinuously monitors the signals to the thermocouples. 
The output of this monitor is fed to a direct-coupled dif- 
ferential amplifier and then to the relay tube. This re- 
lay acts to open the circuit feeding the thermocouples 
whenever the average power exceeds a preset value. The 
time constants of the protection circuit are such that the 
thermocouples are protected from either slow or sud- 
denly applied overload signals, Although the crystal- 
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diode monitor circuit is not perfectly square law, its 
action is adequate in the protective circuit. A time- 
delay relay is used to protect the thermocouples from 
possible overload during the warm-up period before the 
protective-circuit heaters have had a chance to reach 
equilibrium temperature. 

Although some of the circuits of the dip cross correla- 
tor are rather complex, the operation of the equipment 
is simple. Fig. 7 shows the cross-correlator equipment 
set up for operation. The high-speed magnetic drum, 
its accessories, and the correlation meter are mounted 
in the table-like framework. The three relay racks con- 
tain the playback tape transport, power supplies, cir- 
cuits for transcribing data to the drum, gating circuits, 
and the necessary adding, squaring, and averaging cir- 
cuits. A five-trace 21-inch oscilloscope is used for view- 
ing the three dip-meter profile traces, along with a sum 
and correlation interval trace and a bore-hole depth 
trace. 

In operation, any 100-foot section of the log may be 
transcribed to the correlator drum and any interval from 
8 feet to 100 feet may be correlated. Correlation is per- 
formed by alternately turning the micrometers on the 
two movable magnetic heads. As this is done, the output 
of the analog computer is observed on the correlation 
meter for a maximum reading. At this meter reading, 
the dip displacements are read from the calibrated 
micrometer dials. Thus, the displacements needed to 
compute the dip are obtained at a “best-fit” point at the 
maximum of the triple cross-correlation function. Also, 
from the meter reading, the per cent correlation or 
correlation index for the interval is easily computed. 
This is a measure of the degree of similarity between the 
three dip-log data functions. A 100 per cent correlation 
index is obtained only if the three profiles are exactly 
identical. This first correlator model has not been made 
fully automatic. Therefore, it is necessary to set the 
dip displacements along with the orientation data into 
a mechanical analog dip resolver to obtain the true dip. 
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CONCLUSION 


The dip cross correlator possesses several advantages 
over manual or human computation. Actually, some in- 
direct advantages are realized by merely recording the 
data on magnetic tape whereby small, weak signals can 
be amplified to a usable level on playback. Also, a mag- 
netic-tape recording exhibits a greater dynamic range 
and a wider frequency response than the conventional 

_fi'm and paper recordings. Direct advantages of the cor- 
relator are as follows. First, the correlator which is com- 
pletely objective computes a perfectly repeatable an- 
swer obtained by the “best-fit” criterion of the triple 
cross-correlation function. This statement does not 
imply that one answer is always obtained, for the corre- 
lator can give two equally weighted answers for an inter- 
val. However, this is a rare occurrence in comparison to 
the frequent multiple answers that can be obtained by 
manual computation. Second, with each answer, the 
correlator produces mathematical grades that are a 
measure of the similarity between the data traces. 
Third, the correlator can compute signals in the pres- 
ence of incoherent noise; in fact, this type of noise can 
be as large or larger than the signal. Fourth, the correla- 
tor computes data regarded as “impossible” or “no 

good” by the human computer. Fifth, the correlator for 
two dip-logs from the same well produces a better agree- 
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ment between the two sets of results than the human 
computer. Sixth, at present, the correlator with good 
data is slightly faster than the human computer. How- 
ever, it is the exceptional log that has these good data. 
The human computer must spend his time in inverse 
proportion to the quality of the data. Thus, the time 
relation between the correlator and the human com- 
puter is a variable; with poor data, the correlator can 
be as much as ten times faster than the human com- 
puter. Perhaps a utility, but not another advantage, 
of the correlator is the fact that it is an extremely useful 
research tool in the analysis of data, autocorrelations, 
power-density spectra, etc. 

The evaluation of the results of the dip-log cross cor- 
relator is difficult, since no true performance criterion 
exists. That is, the dip of the formations that surround 
a bore hole in the earth is not always known. However, 
in some instances, the geological and geophysical control 
is good enough to allow a direct comparison with the 
correlator results. In most cases, though, the compari- 
son must be made between the correlator results and 
those of the human computer. The results obtained to 
date are encouraging and the correlator has proved to 
be a useful geophysical tool. In some instances, the dip 
correlator has computed reliable results from data 
which could not be worked by a human computer. 
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Summary—Analysis of reactor problems requires the simulation 
of transport lags. This paper discusses the design of a compact and 
relatively simple transport lag utilizing a synchronously-switched 
bank of condensers. 


National Laboratory; z.e., the safe operation of a 
nuclear reactor, is in general well suited to routine 
analysis in the analog form. There are, however, certain 
reactor characteristics which are troublesome to simu- 
late. One commonly encountered difficulty involves the 
transport of a spatially-defined parameter—tempera- 
ture, for example—from one portion of the system to 
another, as in flow through a pipe. Finite velocity lami- 
nar flows require multisecond high-fidelity delays, which 
are difficult to arrange in electrical systems. 
Until recently, the analog circuit used for transport 
lags at this laboratory was an RC time delay based upon 


[one major controls problem at the Oak Ridge 
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Taylor’s expansion of the function f(¢—T). While ade- 
quate for delaying transients with periods at least ten 
times the delay time, this system introduces successively 
greater amplitude and phase distortion as the period of 
the delayed transients becomes comparable with the 
delay time. 

Other workers have used either a faster converging 
series or direct network analysis to develop a more ef- 
fective approximation to the delay function.!~4 The re- 
sultant network, in which a lumped constant LC delay 
line of some complexity is simulated,> has practical 
limitations because of the large number of amplifiers in- 


1C. D. Morrill, “A sub-audio time delay circuit,” IRE TRANs., 

vol. ae SDD: 45-49; June, 1954. 
W. J. Cunningham, “Time delay networks for an analog com- 
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Fig. 1—Switch assembly and mounting. 


volved. A circuit of this type requires at least three 
operational amplifiers when the delayed function has 
component frequencies with periods comparable in 
length to the delay. With more stringent response re- 
quirements, the number of amplifiers goes up propor- 
tionally. A few lags of this type will quickly use up the 
amplifier resources of a small facility. 

Magnetic tape delays,® though generally lacking in 
dynamic range, offer wide bandwidth and a broad and 
easily changed range of delay times. The desirable oper- 
ational features are unfortunately compromised by the 
dollar and space requirements imposed by a respectable 
number of such machines. 

Since problems under consideration indicated the 
need for about six time delays, the development of a 
compact, relatively simple transport lag seemed worth 
while. 

The device shown in Fig. 1 is a synchronously- 
switched bank of condensers which store a sampled 
version of the input function. A writing brush contacts 
each condenser in sequence and impresses on it a volt- 
age corresponding to a point on the time-varying func- 
tion which one wishes to delay. Fig. 2 is a schematic of a 
20-contact transport lag. The amplifier switch con- 
figuration shown performs a 19-point approximation of 
—3f(t—T) when operating on f(t). In the case of an NV 
contact switch, T equals n/NF seconds, where F is the 
rps of the brushes and is the number of contacts by 
which the read brush lags the write brush. AC is a rela- 
tively small capacitor to minimize switching transients. 

Operation of the circuit may be described through 
reference to the functional representation in Fig. 3. In 
the writing case one wishes to obtain a transient solu- 
tion for the voltage e,, to which C, (one of WN identical 


6 D. C. Reukauf, “Simulate transport iags with magnetic tape,” 
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Fig. 3—Operational diagram of function delay. 
capacitors) is charged to be read T seconds later. The 
nodal equations are as follows: 


ey — @s €s — €A 


R a R aad PCE, a €0) (1) 
a POCs tee ee (2) 
r r 


Subtracting (1) from (2), and solving for (e,—e0) =éw, 
gives 


ei 


OS BORG aye) See 


(3) 


When e,(¢) is a step of magnitude E,, (3) may be oper- 
ated on to yield 


Ei 
ew = ze Chewexs iC). (4) 
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and is independent of éo, the voltage being read. 
The amplifier output is related to the constant volt- 
age on the capacitor being read, by 


ea = — A(E, + €0). (5) 
This shows that as A approaches ~, e9 approximates 
—E, for the time AT during which C, is being read so 
that the read voltage is independent of that being simul- 
taneously written “upstream.” Since E,, the voltage 
across C,, was the e,, of m contacts previously, 


E, = E;,/2 delayed, or (6) 
éo(t) = —1/2e(t — T). (7) 


The effect of circuit parameters upon the behavior of 
the system is as follows. The plastic impregnated paper 
capacitors currently used in the switches have time 
constants of the order of 10° seconds. This means that a 
100-second delay between read and write produces a 
maximum leakage error of 0.1 per cent. 

Amplifier grid current also causes loss of charge from 
the condensers. It can be shown that to limit such 
voltage drops to 1 millivolt or less, with grid current of 
10~!° amperes, 


C = 10-7AT, where 
AT = 1/NF = dwell time/contact. (8) 
From (4), it is apparent that the relative error due to 


hasty writing is exp —2A7/(R-+7)C. For a maximum 
error of 0.1 per cent, 


R+yrC . AT 
& : (9) 
2 6.9 
Solution of (8) and (9) for 7/C yields 
6.9(R+4r YUN bs 
\ ) < =< 10% (10) 


2 LarhGh is 

If maximum brush time per contact is two seconds, 
the right-hand portion of (10) indicates the adequacy of 
0.22-microfarad capacitors. If minimum AT is 0.3 sec- 


ond and C=0.22 microfarad, the left-hand portion of 
(10) requires that 


DIKCOrS. 
R+yer< 


eee 10 = 395,000 ohms. 


(11) 

A further restriction on R and ¢ is the requirement 
that they be of such values as will prevent transient 
overloading of the operational amplifier. The values 
necessary are a function of the output stage involved, 
but typical values for a cathode follower limited to 20- 
milliamperes peak current and working between +300 
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PERIOD OF INPUT 
AS FRACTION OF 
DELAY TIME 


RAW OUTPUT 
VS, INPUT 


INTEGRATED OUTPUT 
VS, INPUT 


1.0 


0.5 


0.25 


0.125 


(SQUARE WAVE) 


Fig. 4—Waveforms of delayed outputs for various inputs to syn- 
chronous switch. In each double oscillogram, the lower curve 
shows the input to the switch; the upper curve shows the delayed 
output. 


v and —300 v, are ,=10,000 ohms and R=100,000 
ohms. 

To insure that the write brush never enters a contact 
before the read brush has left it, the 20-contact switch 
described above is run with a maximum lag of 18 con- 
tacts. At such a setting, the maximum error in delay 
time is 1/18 =5.6 per cent. The response of this 18-point 
delay to various frequencies is shown in Fig. 4, and is 
seen to provide reasonable fidelity for signals with peri- 
ods as short as half the delay time. Increasing the num- 
ber of contacts, of course, would improve the frequency 
response proportionally. 

Since contact synchronization is unimportant in this 
system (as contrasted to schemes which switch both 
sides of the capacitors), it should be feasible to construct 
switches with a very large number of contacts whose 
capacitors are intrinsic with the contacts, and thereby 
achieve a higher fidelity transport lag. The present 
switches have been routinely used as transport lags in 
simulated reactor systems for two years and have 
proved satisfactory in that application. One great ad- 
vantage is the ease with which the lag may be varied by 
simply changing brush spacing and/or motor speed. As 
more switches are added to the facility, it should be 
possible to simulate very complex transport systems 
with a modest number of operational amplifiers. 
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HUMAN BEINGS AS COMPUTERS 


The four papers given here were presented April 3, 1957, in Philadelphia, Pa., at a meeting 
sponsored jointly by the Philadelphia Section and by the PGEC. Prof. Miller’s paper was read by 


| Dr. McCulloch—The Editor. 
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Biological Computers’ 
WARREN S. MCCULLOCHT 


of some 10!° neurons. Each has branches, a body, 

and a long, thin, output lead—called an axon. 
The burning of sugar supplies the energy to keep the 
neuron’s outside 0.07 volt positive to its inside. The 
capacity is fixed at, say, 1 uf per square centimeter, but 
its resistance through the surface is highly nonlinear— 
very great so long as the outside is above 0.02 volt to 
0.03 volt positive, but below that value, nearly a dead 
short circuit. Hence we see that if the voltage is reduced 
at any small area, current runs in freely-discharging 
adjacent areas, which then short-circuit, draw current, 
and discharge the next areas. Such is the propagated 
nervous impulse. It proceeds as a smoke ring of currents 
along the axon at a velocity determined by distributed 
capacity, distributed resistance, and distributed source 
of power. The velocities range from about 150 msec to 
1 msec. The impulse has a rise time of less than 0.5 msec 
and a slightly slower decay. We speak of this impulse as 
all-or-none, not in the sense of its being always and 
everywhere of the same size, but of its size at any place 
being determined only by the condition at that place— 
not in any way depending on the strength of the dis- 
turbance that initiated it. In short, a neuron is a dis- 
tributed repeater. So much for the components. 

We call their effective connections “synapses.” Some- 
times we can identify them as places where terminal 
branches of axons of one neuron lie against branches or 
cell body of another, or end in buttons applied to them. 
By “effective” connections I mean only that impulses in 
an axon evoke or prevent impulses in the neuron on 
which or near which that axon ends. In a few places 
where we know the details of anatomy and have the 
proper electrical records, the best guess is that if a fine 
axon courses along a cell body to end on or among its 
branches, it will, by leaving a source of current on the 
body and a sink among the branches, raise the voltage 
of the body and so inhibit its firing; whereas a large fiber 


6 | NHE human central nervous system is composed 
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coming in from among the branches to end on the cell 
body will almost certainly carry impulses to it to excite 
it or to facilitate its excitation. But that is certainly not 
the whole story. 

There is a second way of gating impulses by impulses. 
Consider an impulse in an axon of uniform diameter. Its 
factor of safety for propagation is about 10 to 1. Now let 
the axon branch into two or more smaller axons. Their 
surfaces per unit length may exceed that of the parent 
axon, but their internal resistances go up as the squares 
of their radii go down. Hence the branches demand more 
current and a longer time constant. This demand de- 
creases the safety factor at each successive branch point. 
These fibers are not insulated from one another by 
dielectrics, but their disturbances are short-circuited by 
embedding them in a conductor or common ground— 
say salt water. This does not prevent neighboring fibers 
from affecting one another. Seen from this salt water, 
every impulse is a sink of current preceded and followed 
by a source. Sources in neighboring fibers raise the 
threshold in a given fiber, and sinks lower it. In this 
manner, impulses in neighboring fibers help or hinder 
the passage of impulses to or toward the synapse with 
the next cell. In fact, we have ample proof that this does 
happen in ordinary nervous activity. An impulse dying 
in a fiber certainly tends to block the next farther back. 

What we have said so far insures that those neurons 
in a brain can be and are used as relays in a computer to 
gate all-or-none impulses; but it says nothing of coding. 
We should not attempt that question until we have a 
better picture of the function and general organization 
of the central nervous system. Its function is legion, but 
of one general kind. Every cell in the human body has a 
multiple inverse feedback—giving it great dynamic sta- 
bility. Most of our juices are buffered. This is necessary 
if our parts are to survive in a changing environment. 
But, our body as a whole would die promptly were it not 
for our reflexive mechanisms, each an inverse feedback. 
Of these there are certainly more than a thousand but 
less than a million distinguishable loops. Many pairs of 
such loops acting simultaneously would produce con- 
trary effects (like the motion of the knee in opposite di- 
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rections) or disastrous results (like inhaling and swallow- 
ing). Always, many have to be employed in any com- 
plex act. Hence the principal function of the central 
nervous system is that of computer for an enormously 
complex, multiple closed-loop servosystem. All this is 
too general to be helpful. Let us therefore look at a 
bump at the back of the hindbrain, called the cerebel- 
lum. 

The chief job of the cerebellum is to bring to rest at 
the right place whatever part of the body is put in mo- 
tion. To do this it has first to be informed of the position, 
velocity, and acceleration of each part, which is done by 
paths ascending from the parts, relayed in the spinal 
cord. Next it needs to know the program and subrou- 
tines involved—information that it gets from the basal 
ganglia and the brain stem. In as much as the act occurs 
in a gravitational field and generally requires knowledge 
of the rotation and translation of the head, the cerebel- 
lum has to be informed by that part of the ear which 
handles this sort of information—the so-called laby- 
rinth. Finally, the cerebellum needs information from 
distance receptors by light and sound as to the world 
about it and the objects in it. This information has to 
be processed by the bark of the big brain, the cerebral 
cortex, before it is sent to the cerebellum. Having calcu- 
lated the necessary orders to the muscles to bring things 
to rest at the right places, the cerebellum sends them 
to the so-called reticular formation of the brain stem, 
which relays them to motor nuclei to be combined with 
local information to order the muscles to contract or 
relax in proper fashion. 

The reticular formation plays an important role in 
this regulation. Consider any multiple closed-loop 
servosystem, and suppose that each of its component 
loops is stable but that all control any single effector— 
an aileron or a foot. Now it can easily happen that the 
combination jams the system at one end of its range or 
throws it into oscillation, which may be schizogenic. To 
prevent this happening it is now common practice to 
take part of the input derived from each loop to a com- 
mon adder and feed\it back inversely to many or all of 
the output devices. In the human body the outer and 
upper part of the reticular formation receives impulses 
from all of the ascending systems of information, and 
its descending fibers tend to facilitate all activity; but 
they also play on the central, inner part of the reticular 
formation, which receives the bulk of its input from de- 
scending systems coming from cerebrum, basal ganglia, 
and cerebellum. The output of this reticular formation 
is chiefly down the spinal cord to inhibit all neurons 
from exciting muscles. Its control is so powerful that it 
can stop a convulsion produced by strychnine. This is a 
massive, crude effect of a generalized inhibitor. As yet 
we have no idea how it is normally coded. We only know 
that it requires repetitive firing to be grossly effective. 

Since the nervous system is a parallel, as well as a 
sequential system of computers, coding can be of two 
kinds. One involves which fibers are carrying the im- 
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pulses; the other, the timing of impulses in fibers. The 
first depends largely on the anatomy, the second on the 
physiology of the synapses. Take them in that order. 
There are a couple of million axons from eye to brain, 
say fifty thousand from ears, and about one million from 
the rest of the body, all told. These preserve some 
semblance of their relative positions all the way from 
the surface of eye, ear, and body, through successive re- 
lays to the bark of forebrain, midbrain, and hindbrain. 
It is enough to insure that neighborhood of sense organ 
is converted into neighborhood in_ representation 
throughout sensory systems. Thus the topological rela- 
tions of inputs are preserved (a trick that we should re- 
member in dealing with nonnumerical data) for a ten- 
cent lens is about a million parallel channels, and even 
if it distorts or blurs the picture, it is still safer to trust 
its images than to trust our present attempts to scan 
and reconstruct, as in radar and television. In this sense 
we are as much true space computers as in our servosys- 
tems we are true time computers. Projection of neigh- 
borhood into neighborhood renders the system relatively 
stable under perturbation of threshold of cells, strength 
of stimuli, and detail of connection, even under scattered 
loss of channels—be they axons or celi bodies. These 
advantages make the system resemble the analog de- 
vices wherein most errors are in the last place, rather 
than digital devices using any radix, wherein the error is 
as likely to affect the first as the last digit. So much for 
the anatomy. 

Now for temporal coding! When Pitts and I con- 
structed the first calculus for neuronal nets, or repeater 
nets, we took it for granted that we could pass only one 
bit per impulse, that is, about one per millisecond. But 
increasing knowledge of fibers showed that with an 
axon receiving a constant stimulus, it emitted a spike 
with a delay that scattered only some 20 to 30 usec, and 
that two impulses that summed fully at 120 usec failed 
to sum at all at about 160 usec. Hence the reliability 
with which it detects and emits by pulse interval modu- 
lation. This, MacKay and I calculated—showing that in 
this manner one could pass far more information at far 
lower duty cycles than we had previously expected. 
Alexander Andrew then showed that still more could be 
passed by better coding, making more use of shorter in- 
tervals. Then came our work on the input neurons. It 
showed that the maximum rates that could be got past 
its branch points was far less than had been expected. 
We presented that work, as a more realistic upper bound 
on information capacity, at the London Symposium on 
Information Theory. I mention this specifically because 
our difficulty was this: interference would cause omis- 
sion of signals in neighboring channels, most when they 
were closest in time and represented points most closely 
located in muscle or skin. No one yet has been able to 
optimize the code for these kinds of noise, so we cannot 
put a reasonably high lower bound on information 
capacity. Amassian has shown that some cells in the 
cerebral cortex code into pulse interval modulation in- 
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formation as to the place whence their excitation came, 
This cortex is the organ that abstracts the ideas of ob- 
jects about us from sensory inputs of any kind. 

Let us, therefore, turn to some things we do know 
about actual coding. While there are a few examples of 
simple all-or-none items, sense organs generally code 
the logarithm of intensity into frequency. They can do 
this for any quantity—brightness, loudness, length, and 
so forth—or for the first derivative, and sometimes for 
the second derivative. There are also a few that emit 1m- 
pulses at a given frequency when there is no signal and 
produce a simple increase or decrease of frequency for 
the strength of signal. For example, the vestibule, the 
organ of balance and acceleration in the ear, sends in a 
basic frequency of, say, 39 impulses per second and adds 
or subtracts from that frequency as the head is ac- 
celerated. 
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Now we return to the problem of the synapse. Some 
neurons are simple coincidence detectors; some, on 
receipt of appropriate information, emit a train of im- 
pulses; and still others, like those of the balance organs 
and the big output cells of the cerebellum, deviate in 
either direction from a fixed resting rate according to 
the signals reaching them. One of the most instructive 
groups of cells is the next relay in the vestibular system, 
for it emits a signal at the frequency which is exactly 
the difference between the carrier frequency—say 39 
per second—which it had been receiving and the fre- 
quency that it now receives. So for 36 or 43 it emits 3 per 
second. In short, for a synapse in general there is no way 
of knowing what sort of a function the output is of the 
input. Until you examine it, all you can say is that the 
synapse is some sort of filter—almost certainly nonlinear 
—which only says it cannot operate on future informa- 
tion. 


The Complexity of Biological Computers’ 


H. QUASTLERt 


Summary—Man can handle small amounts of information in 
conscious purposeful activities. However, the concept of information 
processing is not limited to these; it applies equally to unconscious 
nervous control, and even to chemical control and coordination of 
metabolism. On this level, the amounts of information computed 
are enormous; man processes about 3X10*™ bits per day just in 
the course of producing biochemical tools. The general pattern for 
these computations is laid down in a blueprint containing 10° to 10° 
bits of nonredundant information. Such numbers are characteristic 
of living things in general. These informational feats are performed 
with high over-all reliability in spite of frequently low precision of 
single acts. This is accomplished by prodigious degrees of re- 
dundancy. 


AN’S capabilities of handling information ap- 
MM. pear sharply limited. In a single act of informa- 

tion processing he can operate the equivalent of 
about seven independent channels, getting a few bits of 
information through each. Such acts can occur at rates 
of up to about 20 seconds. At high speeds, the amount of 
information per act decreases; a total rate of about 25 
bits per second is all that man can sustain, and that only 
by means of highly trained activities and only for 
limited periods of time. However, these figures do not 
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tell the whole story; they refer only to that fraction of 
human information processing which can be utilized for 
transmitting information according to rules imposed 
from without. They measure man’s ability of recogniz- 
ing particular stimuli in real situations and responding 
to them by consciously initiating particular actions ac- 
cording to some agreed-upon scheme. 

Concurrently with such activities, a vast variety of in- 
formation processing activities are going on which are 
not included in the human engineer’s measure of per- 
formance. For instance, while a man is reading data 
from some display, he also measures the amount of light 
which reaches the retina and adjusts the width of his 
pupils accordingly: this involves processing of informa- 
tion, although he is not aware of it. At the same time, 
the skin temperature is measured and this information 
is transduced into orders to blood vessels and sweat 
glands: that is information processing. The blood is 
checked for its CO: content, and this information serves 
to regulate respiratory activity: that is information 
processing. Nor is all interaction with the surroundings 
restricted to the nervous system. Along the intestinal 
tract amount and composition of ingested food are re- 
corded and this information is transduced into a spec- 
trum of chemical messages which regulate the secretion 
of digestive juices: that, too, is information processing. 
Those juices themselves contain enzymes which sens¢ 
various chemical configurations and respond to the 
proper signal with formation of an activated complex 
and subsequent splitting: even that implies informatior 
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processing. It is seen that conscious transmitting of in- 
formation is only a very small part of man’s communi- 
cating with his surroundings. Furthermore, for any 
given biological unit such as an individual cell, the vast 
majority of signals comes not from the outside world but 
from other cells. Accordingly, interactions with the out- 
side world account for only a very small fraction of the 
total information traffic and are embedded into a tre- 
mendous volume of internal communications. 

In considering the complexity of biological computers, 
it is the enormous amount of total information traffic 
which is of interest, not the small amount which can be 
utilized for purposes of conscious information transmis- 
sion. The use of terms like “information” and “com- 
munication” in dealing with involuntary processes is not 
a matter of loose analogy. There is nothing in the in- 
formation concepts which restricts their use to volun- 
tary processes. The measure of information is defined by 
the degree of selection resulting from a decision process 
and does not depend on why, how, or for what purpose a 
selection was made.? Accordingly, the selection of one 
out of 20 amino acids by a constellation of chemical 
forces, based upon the configuration of a reactive sur- 
face, is just as good an act of information processing as 
the selection of one out of 26 letters, initiated by con- 
scious choice, motivated by some idea one man is trying 
to communicate to another. The amount of information 
processed depends only on the range of selections avail- 
able: selecting one out of 20 amino acids is worth up to 
4.3 bits, one out of 26 letters up to 4.7 bits, one out of 4 
nucleotides up to 2 bits, the upper limit applying when 
the selection is not prejudiced by unequal a priori prob- 
abilities.’ 

Most or all biological “decisions” depend ultimately 
on specificity of chemical reactions. In most or all bio- 
chemical processes decisive roles are played by large 
macromolecules which as a rule have the following char- 
acteristics: they have a backbone which is a unidimen- 
sional crystal usually of helical shape as linear crystals 
are bound to be;* attached to the backbone at regular 
intervals are simple organic molecules which form a 
nonperiodic sequence. These are drawn from pools with 
a limited inventory. The structural and functional spec- 
ificity of such macromolecules determines in what acts 
of information processing they can participate, specify- 
ing a macromolecule is equivalent to selecting a particu- 
lar message out of a set. It appears that this specificity 
is largely (though not exclusively) determined by the 
sequence of simple organic molecules lined up along the 
backbone.® The principle is exactly the same as a per- 
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son’s producing a message by means of a typewriter. 
The movements of the carriage provide the “backbone” 
of regularly spaced sites; at each site, any one of 83 ele- 
ments can be placed. The choice of a string of elements 
specifies the message and the desk, chair, paper, and 
ribbon are appropriate ingredients of the process. In the 
same way, the general ambient of the cell interior pro- 
vides the proper background for coding information in 
form of molecular sequences. For instance, a specific 
protein will consist of a few hundred amino acids in a 
particular sequence. To make this particular protein 
what it is, amino acids have to be separated from other 
cell constituents; each amino acid has to be selected out 
of a set of about 20 and laid down in the proper position. 
This is done by a chain of processes of selection, each 
mediated by chemical attraction and repulsion, and 
somewhere in the cell must exist the information needed 
to execute the proper selections. This information is 
coded into a different kind of macromolecule, carrying 
inscriptions with an “alphabet” consisting of only 4 
“letters”; that is, the blueprint of a protein as it exists in 
a cell looks quite different from the actual protein.® 

The number of macromolecules synthesized by a man 
in a single day necessitates the proper arrangement of 
about one mole (6X10” molecules) of simple organic 
molecules. Allotting about 5 bits per molecule to make 
the proper selection (which estimate is probably correct 
within an order of magnitude), the informational per- 
formance is estimated at about 3X10 bits per day, or 
about 4X 10!* bits per second. This is a very impressive 
amount indeed if one considers that a substantial book 
contains about 10’ bits of information. Yet the synthesis 
of specific macromolecules represents only a fraction of 
the total informational performance 2f living things and 
accounts for some of the information needed in con- 
structing metabolic tools, not for the information needed 
in using them. 

Most of the information flow of some 1019 bits per 
second is redundant (as is much of the 107 bits in a sub- 
stantial book). The coordination of redundant informa- 
tion depends on a common pattern. This common pat- 
tern is laid down in a network of central stations (cell 
nuclei, about 10‘ of them) which were all derived with 
not very large variations from a single original blueprint. 
The original blueprint is contained in every fertilized 
egg, and we are fairly certain that its major portion is 
coded upon a particular backbone by means of a 4-letter 
alphabet.® There are roughly 10! such letters in a ferti- 
lized egg; of these, many appear to be redundant. It has 
been estimated that the nonredundant information con- 
tent of the blueprint in the fertilized egg is between 10° 
and 10° bits.* The information content of the blueprint 
measures the minimum complexity of the finished struc- 
ture; the final total information content will be larger 
because of numerous replications with partial modifica- 
tions of some replicates based on individual experience. 
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On the blueprint level man is only one or two orders of 
magnitude more complex than a lowly bacterium, but 
even the blueprint of a bacterium is of very respectable 
complexity if compared to the information needed to 
describe efficiently and without repetition a so-called 
giant electronic brain. 

These blueprints of the organism are reproduced by 
man and bacteria alike with great accuracy and speed. 
A bacterium will manufacture its own complete blue- 
print in about 1000 seconds with effective error rates 
somewhere around 107! per bit. This is an effective 
error rate; its low value does not necessarily reflect the 
precision of the primary acts but could be the result of 
secondary error checking and correcting. While the blue- 
print is reproduced, amounts of information several 
times larger are invested into building and using meta- 
bolic tools. In this case there is good evidence indicating 
that the precision of the individual acts is not high. 

It appears to be generally true for most biological sys- 
tems that the requirements for precision in each single 
act are low. Yet, although the total amounts of informa- 
tion processed are enormous, the over-all reliability is 
exceedingly high. Man and animals go through many 
satisfactorily accurate duty cycles before finally break- 
ing down. This over-all reliability in spite of low ele- 
mentary reliability must depend on a very high degree 
of redundancy, although admittedly, we do not know in 
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any detail the codes which are being used for error 
checking and control. 

It is possible that there is a message for engineers in 
the organization of biological computers. Traditionally, 
the engineer’s ideal is to eliminate redundancy and to 
perfect elementary reliability, and this is achieved dur- 
ing a more or less extended period of collecting case his- 
tories and correcting specific shortcomings. As systems 
get very complicated, this method becomes less and less 
feasible. Where there are very many possible shortcom- 
ings, it takes too long to find and correct them one by 
one. Some of the most complicated information handling 
devices now in use seem to crowd the limits of engineer- 
ing possibilities. It is possible that such bounds may be 
broken by using enormous degrees of redundancy to 
cope with unforeseen as well as with known difficulties; 
this can be combined with low elementary reliability in 
order to allow adequate statistical treatment of errors. 
This can be done if we can learn to rely on design rather 
than elementary perfection for over-all reliability. These 
thoughts are heretical but not new. They have been 
talked and written about’ but translations into practice 
have been few and rather half-hearted. The capabilities 
of radically redundant systems represent a definite chal- 
lenge to engineering. 
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A Note on the Remarkable Memory of Man* 


GEORGE A. MILLERT 


HE number of bits per second that a man can 
[iat in through his receptors and pass on immedi- 

ately to another man is quite small; our best esti- 
mate at present is about 25 bits per second, and this is 
obtained only under optimal conditions. When we con- 
sider the amount of information a man can hold in mind 
at one time, as measured by his span of immediate mem- 
ory, our estimates depend critically upon the way the 
information is encoded. Most of us can apprehend about 
five or ten chunks of information at once, where a chunk 
may contain as much as, say 15 bits—a total of perhaps 
100 or 150 bits that we can consider at a time. 

In spite of these relatively low limits on the amount 
of information the average man can actively process, the 
opinion is often advanced that we have a remarkably 
large memory, even though it often takes us a long time 
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to retrieve what we know from the store. For example, 
it has been said that it would require about 1500 bits to 
store the multiplication table and that the average man 
must know at least 1000 items as complex as that. As a 
lower bound, therefore, the human memory must hold 
at least 1.5 million bits. As an upper bound, we could 
assume that a person who can process 25 bits per second 
might remember everything for 16 hours a day for 80 
years which gives about 43 billion bits. A middle value 
of 100 million bits has been called a “reasonable guess.” 

It is extremely difficult for a psychologist to decide 
whether such estimates are meaningful. It seems very 
possible that when we try to recall a fact from memory, 
what we do is often more analogous to reconstruction 
than to simple retrieval. For example, even though we 
are supposed to have memorized the multiplication 
table, many of us use various devices for inferring, 
rather than remembering, the larger products (e.g., 
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7X9=7xX [10—-1]=70—7=63). Psychoanalysts have 
described the reconstruction that goes on in remember- 
ing and reporting dreams, and lawyers are quite familiar 
with the distortions that reconstruction can introduce 
into testimony. Introspections and anecdotes are not 
reliable evidence for inferring the capacity of the mem- 
ory since the things remembered are isolated instances 
and seldom is their accuracy verified. 

An important feature of human cognition is our con- 
stant tendency to relieve the strain on our memory by 
finding rules, or systems of rules, which regenerate the 
facts of our experience but are shorter and easier to 
store than the experiences which they represent. For 
example, on the basis of a few, perhaps a hundred, 
grammatical rules that we acquire after a finite exposure 
to our native tongue, we are prepared to generate or to 
understand any one of an infinite set of grammatical 
sentences. Or again, on the basis of a simple formula and 
the rules of mathematics, we are prepared to summarize 
the results of thousands of experimental observations on 
falling bodies, or the volume of a gas, or the positions of 
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the stars, etc. Or, on the basis of simple classifications 
like “Jew,” “Negro,” or “Nazi,” we are prepared to be- 
have in a uniform way toward thousands of our fellow 
men. We usually reorganize and simplify our experience 
before we try to store it away in memory. 

We are not always consciously aware of applying 
these rules. Thus, it isextremely difficult to tell from in- 
trospection whether an item was recalled directly from 
memory or was calculated by rules that are stored in 
memory. If, as seems likely in most cases, the answer is 
calculated rather than stored, we cannot estimate the 
amount of information a man has stored until we know 
the rules of calculation that he used. 

And, the rules cannot be observed directly in most 
common instances. 

At the present time, therefore, it is more important to 
determine the kinds of rules we use than to put numeri- 
cal estimates on the available size of the human mem- 
ory. It may yet be possible to account for the remark- 
able memory of man with fewer bits of storage than we 
currently estimate. 


The Human Computer in Flight Control" 
LAWRENCE J. FOGEL+ 


Summary—lIt is the unique decision-making ability which makes 
the human operator particularly suited to accomplish flight control 
computation. His decisions range from the simplest repetitive deter- 
mination of control actions, each intended to minimize the error, 
to complex problems of the sequential reprogramming of all the lower 
levels of decision which, in totality, comprise his information trans- 
duction process. The human sensory-input and motor-output chan- 
nels must be properly used in order to insure maximum efficiency of 
the over-all human computer. The perceived noise can only be sepa- 
rated from the signal after the decision-making operation to be per- 
formed has been clearly identified. Human noise filter and informa- 
tion handling rate characteristics may be enhanced through the 
utilization of inherent qualities of the various input and output chan- 
nels. 

A brief summary is made of the considerable effort which has 
been devoted toward the development of mathematical models for 
human tracking. It is emphasized that the human decision-making 
ability must be incorporated into the model before a realistic repre- 
sentation can be attained. A stochastic model is considered which is 
constructed in a heuristic manner, incorporating the decision-making 
ability. Specific direction is indicated which may yield the most 
fruitful approach to the mathematical analysis of human flight 
control computation. This future model would be of great value as a 
link between the related work in the fields of neurophysiology, bio- 
physics, and psychology. Most important, it should provide a cockpit 
synthesis technique which will aid the design of future manned 
aircraft. 
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INTRODUCTION 


HE unique ability which makes the human 
iiGees: particularly suited to the performance of 

flight control is that he can program and repro- 
gram his computation while the flight is in progress. The 
word “computation” is intended in its broadest sense: 
the transduction of the received data into corrective 
control actions to accomplish the desired mission. 

This reprogramming may be looked upon as a de- 
cision which occurs at a particular level within a hier- 
archy of decisions relevant to the mission. This hierarchy 
may be grossly characterized as follows: 

1) Decision that determines the general mission pro- 

gram to accomplish the flight objective, 

2) Decision that determines the implicit flight path 
to accomplish this desired program, 

3) Decision that determines the computation pro- 
gram which will be used to process the data so as 
to accomplish this flight path in an optimal man- 
ner, 

4) Decision that determines the state of the aircraft 
from the displayed information, 

5) Decision that determines the manner of control 
operation which will minimize some function of 
the anticipated error. 
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These classifications are not mutually exclusive, but it is 
easy to see that they are distinctly ordered. They must 
be performed in an ordered sequence to lead to effective 
flight control. 

It is obvious that the highest level decision must be 
accomplished in accordance with the requirements of air 
traffic control or the assigned strategy from military 
headquarters. The pilot must initiate his activities to 
execute the results of such decisions. He must be aware 
of their outcome but he does not take part in the de- 
cision-making at this level. The remaining levels of de- 
cision are normally left to the pilot who pre-plans the 
gross flight path (and files a flight plan) and chooses the 
detailed airpath while the flight is in progress. His flight 
plan is a result of the application of a set of procedures 
and constraints to the presented problem of mission, 
traffic, weather, etc. His airpath selection is accom- 
plished by reference to his experience with weather, fuel 
consumption, flight time, and other characteristics of 
the aircraft. For example, an interceptor pilot may pre- 
plan a minimum time climb to the target altitude; how- 
ever, as the situation develops he may modify this 
chosen airpath so as to approximate minimum fuel con- 
sumption requirements, or be of some intermediate na- 
ture between these two extremes. The pilot must rely 
upon his memory, the summation of his experience to 
accomplish this latter decision. 

The remaining levels of decision are the subject of the 
following discussion. The pilot’s decision at the third 
level is concerned with the program for his information 
transduction processing. The fourth level relates to the 
decisions which establish the nature of the data received 
for processing, the separation of signals from noise. The 
fifth level decisions pertain to the required modification 
of the output data to allow efficient coupling to the air- 
craft system. 

The human computer offers remarkable flexibility but 
also certain specific limitations. The fullest use can only 
be made of the man if his characteristics are well known 
to the cockpit designer. It is the purpose of this paper to 
examine some of the most important flight control quali- 
ties of human information transduction. 


DISCUSSION 


Prior to considering the information transduction 
process, it appears desirable to examine some aspects of 
the human computer’s input and output channels. The 
battery of senses with which man is equipped provides a 
mass of data about his environment. Unfortunately, 
much of this information is noise and very little is signal; 
noise being defined as any information not of direct 
relevance to the decision which he is about to make. It, 
therefore, follows that the nature of the decision must be 
determined before any judgment may be reached re- 
garding what is signal and what is noise. To illustrate, 
consider the pilot’s reaction to an extra-tight shoulder 
harness. If his immediate concern is fuel management, 
these data received through his tactual sense are a bother- 
some disturbance, a noise which can only degrade his 
decision-making ability. On the other hand, if his con- 
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cern happens to be the adjustment of the shoulder 
harness, the degree of this tightness is the information 
he desires to examine. 

Noise may be either spatial or temporal, or both, de- 
pendent upon the sensory channel which is used to re- 
ceive the information and the nature of the sequential 
decisions. Such disturbance can only be minimized by 
providing the pilot with a tight coupling communication 
to and from the aircraft system. Such a coupling is char- 
acterized by the term “compatible.” Before considering 
some details of the actual information transduction, it 
seems worthwhile to note that the importance of com- 
patibility is as great in using the human in flight control 
as is making the proper input and output connections on 
any laboratory computing device. In the latter case, an 
error is quickly recognized and corrected; however, 
coupling errors between the man and machine are often 
difficult to detect and, once detected, often are almost 
impossible to completely eliminate. 

Appendix I indicates some of the man vs machine 
characteristics which should form a guide to the choice 
of the type of function to be left to the pilot. Assuming 
that this primary operational design has been deter- 
mined, compatibility may be increased by noting that 
each human sensory channel has individual time adapta- 
tion and importance characteristics, as well as a maxi- 
mum number of degrees of freedom. For example, the 
kinesthetic channel has adaptation which is dependent 
upon the imposed “g” force vector of a maneuver. Hu- 
man sensing of the vertical to the earth should note this 
time relaxation characteristic of the kinesthetic display 
which always feeds information to the pilot. To ask the 
pilot to operate from one visual “vertical” while his 
body displays another “vertical” is imposing a condition 
which might easily induce vertigo. 

Although the tactual and olfactory channels are se- 
verely limited as far as precision and channel capacity 
are concerned, they are the most natural channels for 
the display of warning or emergency status. The most 
natural meaning associated with a sudden tactual stim- 
ulation is “danger.” Such a perceived stimulus cannot 
be ignored by the pilot, as he might easily miss a warn- 
ing light or even fail to interpret properly a klaxon horn 
which tries to inform him of an impending “wheels up” 
landing. It is through these channels that low prob- 
ability, high surprise value information events are the 
most efficient information to display. 

Each mode of display has a “dimensionality”; the 
number of independent qualities which can be used to 
portray additional information. For example, in a two- 
dimensional visual display a point position corresponds 
to two coordinate data. In addition, the position may be 
coded with a shaped block. Shape then becomes another 
dimension of the display. Color is another possibility, 
etc. These dimensions are not all usable with the same 
precision or accuracy but each can contribute some ad- 
ditional information, provided the human channel ca- 
pacity is not exceeded. Probably the simplest and most 
efficient visual display dimension is the position of a 
point along a coordinate axis. Measurements have 
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shown the amount of average information which can 
thus be identified to be in the order of 3 bits per dimen- 
sion.!? The use of two points on two scales almost 
doubles the visual display information capability. 
Three scales offer some added information but the sum 
of the three information rates is certainly not the same 
as three times each scale presentation. Further increase 
of dimensionality soon reaches a crossover point at 
about eight or nine coordinates. Any further increase de- 
grades the visual display.’ 

Certainly, it is valuable to supply all the required in- 
formation to the pilot but such display takes its toll in 
terms of fatigue,* inaccuracy in his information proc- 
essing, and the imposition of a stressful condition which 
makes the operator introduce subjective noise and clut- 
ter into the displayed data between reception and per- 
ception.» When the human operator functions near 
channel capacity,*~’ it is normal to find that each error 
sets off a train of succeeding errors due to the additional 
data provided by his recognition of the first error. The 
channel capacity has been exceeded and the excess in- 
formation offers confusion which in turn decreases the 
remaining channel capacity.®!° The human operator has 
wonderful ability to extrapolate data!” and make a 
priori decisions. This characteristic will be analyzed in 
detail below, but it is only relevant at this point to 
recognize that this device provides an information 
“smoothing” which can allow a little forethought to keep 
the pilot from being pushed beyond his limiting channel 
capacity. 

In dealing with the human operator in a multivariate 
situation, it serves to increase efficiency as well as flight 
safety to allow each variable to take on a specific desig- 
natory meaning. It yet remains to determine an analytic 
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technique for measuring the amount of this meaning, 
however, meaning certainly aids in the separation of 
parameters, elimination of possible ambiguity errors, 
and memory access. To maximize the benefit from 
this human ability, it is well to offer an over-all cockpit 
structure for both displays and controls which pro- 
vides a contextual background for the acceptance of 
data from each flight parameter. To illustrate, consider 
the logic of a proposed cockpit which provides pictorial 
information about attitude and map position in the 
center, then proceed to the right to provide the result of 
angle of attack and pitch—rate of climb. It is followed, 
reading further to the right, by the resulting altitude 
which may be read in numeric value from left to right 
with succeeding levels of increased precision. The right 
hand has access to the pitch, angle of attack, and roll 
attitude control. 

Proceeding to the left from the central attitude and 
map display first provides forward motion data, angle 
of attack, indicated air speed and Mach number. Ve- 
locity information leads to concern for the passage of 
time—a numerical clock is placed over the engine in- 
struments which supply the data concerning the causal 
thrust. These engine instruments, themselves, should be 
arranged to agree with the causal relationship so that 
fuel gauges would reside at the extreme left of the in- 
strument panel being directly adjacent to the throttle 
control which is operated by the pilot’s left hand. Such 
an over-all logic seems to offer a rationale for aircraft 
panel standardization which provides a positional con- 
text to assist the identification and perception of the 
many variables. 

The efficiency of the output coupling of man-to- 
machine is a function of the control stick sensitivity and 
displacement range. Standard human engineering data 
have appeared which describe efficient designs in this 
regard.'* Obviously, the coupling of binary decisions is 
better suited to switch or push-button devices, while 
continuous variables are best communicated to the ma- 
chine by position or force sensing control sticks. The 
configuration of these controls should directly relate to 
the display configuration so as to minimize any coordi- 
nate transformation which would be required on the 
data resulting from human transduction.!*"6 

The often suggested “ultimate” in control design 
should be re-evaluated. It consisted of manual controls 
which agreed with the earth-reference coordinate sys- 
tem. The pilot’s over-all purpose would be simply 
executed by a vertical movement of a control member to 
change the aircraft altitude and a horizontal movement 
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to alter its heading; these actions being transformed into 
attitude directives by a computer. No consideration has 
been given to the compatibility of such controls with 
the kinesthetic display sensed by the pilot. So long as 
manned aircraft have wings, it appears of greatest 
value to allow the pilot to directly manipulate the atti- 
tude of the aircraft, and in this manner achieve the 
highest degree of compatibility between the control and 
the display. 

The human information transduction itself has been 
the subject of a large number of investigations with the 
consistent effort to express the transfer characteristics in 
some mathematical form.17~*! Much has been accom- 
plished, yet the universally recognized nonlinearity and 
time varying characteristics make the task extremely 
difficult. The initial efforts looked toward approximat- 
ing a linear invariant transfer function for various types 
of stimuli including sudden step functions of different 
amplitude, random continuous motion of known band- 
width, and periodic waveforms. The frequency response 
of the tracking was plotted on a Bode diagram and 
fitted in standard servo analysis manner (using straight 
line db vs frequency fall-off characteristics from the 
identified break points) to provide the form of the trans- 
fer function. McRuer has done an excellent survey of 
this work” and has summarized the findings in the form 
of a control to visual displacement ratio, 
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where: 


1) The reaction time delay is represented by e~** with 
7 having values ranging from 0.2 to 0.5 second for 
average random stimuli. If the stimulus becomes 
predictable to the pilot, he may begin to generate 
an output which replicates the input and is syn- 
chronized with it. When such is the case, 7 be- 
comes negligible. Any phase discrepancy is not 
due to the reaction time delay. On the other hand, 
7 may be greater than 0.5 second dependent upon 
the interpretability of the perceived data. 

2) The neuromuscular lag, Ty, is normally within the 
range between 0.1 and 0.16 second for the arm. 

3) The lead time constant, J, has been observed to 
have values between 0.25 and 2.5 seconds; how- 
ever, these values are certainly not the limits to its 
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range. This constant is a function of both the dy- 
namic response of the aircraft and the bandwidth 
of the visual stimulus. This linear factor in the 
numerator provides a 6 db/octave rise in the gain 
characteristic from the break point identified by 
w=1/T, which may be looked upon as the added 
importance the higher frequency harmonics re- 
ceive as they infer anticipatory information. 

4) The lag time constant, Tz, with observed values 
between 5 and 20 seconds can have any value, de- 
pendent upon the aircraft dynamics and the 
stimulus bandwidth. This “integrating” linear fac- 
tor provides a smoothing of the input data so as to 
allow the output spectrum generated to approxi- 
mate better the response spectrum of the aircraft. 
The closer this term approximates pure integra- 
tion, the more relative importance the pilot has 
attributed to “drift components” of the stimulus, 

5) The gain, Kp, is adjusted by the pilot to allow 
proximity to the point of marginal stability. For 
tasks requiring greater sensitivity and accuracy he 
would raise the gain. For more relaxed flying “on 
a Sunday afternoon,” he would decrease the gain 
and allow the aircraft to “fly itself” more. The 
accuracy criterion which appears most likely* is 
the minimization of the rms error. This criterion is 
also dependent upon the presumption of time in- 
variant transfer linearity. 


A number of nonlinear models has been considered. 
One report” indicates the additional assumptions of rate 
judgment (by adding a weighted derivative of the stimu- 
lus), rate threshold (which notes that certain observed 
errors are normally disregarded as being of negligible 
importance since their average value of zero will be ap- 
proached in a relatively short time), and clamping (a 
first order hold which the pilot normally applies to con- 
trol between the correction of new errors). This model 
was a sufficiently close approximation to allow its sub- 
stitution for the pilot in a cruise simulation for periods 
up to thirty seconds without the pilot’s detection of the 
substitution. The particular values chosen for this 
“pilot analog model” were taken from the residue error 
from previous analyses of tracking control using the 
aforementioned linear invariant model. 

An alternate nonlinear approach was suggested by 
J. Elkind. It rested upon choosing a family of linear 
transfer functions which were interchanged depending 
upon the amplitude of probabilist aspects of the stimu- 
lus. Another presumed to find a piecewise linear fit best 
as a function of amplitude based on empirical data 
plotted on the phase plane.” Only cursory experiments 
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were performed but the separation of domains and 
switching lines appeared possible. Other investigators 
were concerned with the hypothesis of a sampled data 
servosystem model;”*:?? however, as yet no sufficiently 
complete study has been performed which would prove 
the hypothesis that the pilot actually operates only at 
discrete times. Of course, application of the generalized 
sampling theorem?’ makes it possible to show that cer- 
tain empirical data are equally valid for a continuous or 
discrete time model. 

The essential stochastic nature of the human operator 
was recognized by J. North who reported a statistically 
variant linear model to account for the variability and 
pilot error in tracking. In references?®—*! he states, “Some 
psychologists have considered that the stochastic oscil- 
lations were evidence of a discontinuous process; this is 
seen not to be the case.” His point is well taken; how- 
ever, no conclusive proof has yet been presented which 
will confirm or deny this long standing hypothesis. 

The purpose of any mathematical model is to allow 
the prediction of empirical data; however, this is not 
quite enough. The model should also be based on some 
heuristic foundation, so that an hypothesis concerning 
the subject of investigation can be turned into a princi- 
ple or disregarded in favor of some new hypothesis. 
There is required some practical compromise in the 
formation of such a testable hypothesis. First, it must 
be a reasonable guess concerning the nature of the hu- 
man operation. This could easily lead to forbidding com- 
plexity. On the other hand, the conceptual model should 
be simple enough to allow for mathematical computa- 
tion. The greatest advance is made through the use of 
the most specific conceptual model which is mathe- 
matically expressible in complete form and can be vali- 
dated by empirical data. 

A recent paper® proposes a purely stochastic model 
for the tracking behavior of a pilot. This model is differ- 
ent in that it speculates the single-valued operation of 
the human so that the pilot forms a sampled data sys- 
tem for each of the many parameters he considers. First 
order hold smoothing is utilized upon each discrete error 
correction control to synthesize the actual continuous 
multiparameter operation of the pilot. The model is 
expressed as a cascade of operations, each defined by the 
transformation of the probability density function as- 
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sociated with the received signal element. Such a model 
allows human anticipation to be expressed in the reason- 
able form of a diffusing probability distribution which 
agrees with the known informational aspects of human 
prediction. The sampled data operation requires the use 
of a memory of at least the last data for each parameter. 
This memory operation satisfies the same specific hy- 
potheses as the anticipator element once the time origin 
has been shifted from the present to that time in the past 
when the memory received the information of immediate 
concern. Fig. 1 illustrates this model and Appendix II 
indicates that portion of the mathematics which de- 
scribes the anticipator-memory operation. 

Currently an experimental program is in progress at 
Convair for the purpose of obtaining design data for op- 
tional anticipatory displays. A simulated aircraft is con- 
trolled by naive subjects and jet pilots with the auto- 
matic recording of the error criteria as well as the 
Galvance skin response of the subject. Cursory trials 
were based on previous work**—** and seem to indicate 
that this latter measure identifies the amount of antici- 
pation when a single discrete time event is about to 
occur. These same data can also be interpreted for other 
information about the subject, such as stress level, level 
of alertness, fatigue, etc. 

A “rules of choice” element is included which pre 
sumes a time-varying transfer characteristic which ex- 
presses the weighting of importance the operator im- 
poses on the perceived magnitude of the signal element. 
Here is included both the operational threshold which is 
chosen in accord with the required precision of flight 
and the saturation quality the importance weighting 
must have as it reaches a maximum magnitude. Modifi- 
cation of this transfer characteristic is what has been 
previously referred to as re-programming, as one corre- 
sponding to a variational calculus problem. 

Tracking may be looked upon as a decision process 
where the same decision to minimize some function of 
the error is sequentially repeated. The error criteria may 
be taken as invariant provided the higher level re- 
programming decision is also allowed. In fact, the same 
functional criteria could be the basis for the choice of 
the importance weighting program itself. Such specula- 
tion emphasizes that the one feature which has been 
omitted from previous models is probably the most es- 
sential element; that is, the decision-making ability. 

Decision theory has only recently received intensive 
investigation;*°8” however, most attention has been 


33 FE. A. Haggard, “Experimental studies in affective processes: I. 
Some effects of cognitive structureand active participation on certain 
autonomic reactions during and following experimentally induced 
stress,” J. Exper. Psychol., vol. 33, pp. 257-284; 1943. 

344. A. Haggard and R. Gerbrands, “An apparatus for the meas- 
urement of continuous changes in palmar skin resistance,” J. Exper. 
Psychol., vol. 32, pp. 92-98; 1947. ‘ 

35 E. W. Geldreich, “The use of a calibrated potentiometer in the 
measurement of the galvanic skin response,” Amer. J. Psychol., vol. 
47, pp. 491-493; 1935. 

36 A. Wald, “Statistical Decision Functions,” John Wiley & Sons, 
Inc., New York, N. Y.; 1950. 

37 T). Blackwell and M. A. Girshick, “Theory of Games and Sta- 
tistical Decisions,” John Wiley & Sons, Inc., New York, N. Y.; 1954. 
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Fig. 1—Single parameter mathematical model of information transfer system. 


focused on the mathematics of optimal decision making 
(the theory of games). The concern here, however, is 
how the human pilot makes decisions and this can be a 
very different matter under some circumstances. Sev- 
eral papers**~*° have noted this disparity and some 
propose alternative calculi for the model of human de- 
cision making.*!? This field is young and awaits ex- 
haustive investigation of the individual models. Much 
effort has been devoted to the detection decision.* “Is 
there a signal embedded in the perceived noise?” This 
latter investigation emphasizes the subtle nature of hu- 
man decision making by pointing out that information 
which is displayed below the level of conscious aware- 
ness is still received by the human operator and may be 
extracted from him by a forced choice situation. This 
finding removes the traditional belief in a fixed lower 
threshold to perception and replaces it by a probability 
of reception which asymptotically approaches zero for 
decreasing size stimuli. 


CONCLUSION 


Man’s greatest value as a pilot can only be achieved 
when his decision-making capacity is utilized to the 
fullest extent. These decisions range from the simplest 
choice of error correcting actions to the selection of a 
transduction computation program. Further studies di- 
rected toward structuring a mathematical representa- 
tion for the human operator should find it possible to 


38 W. Edwards, “The Theory of Decision Making,” Psychol. Bull., 
vol. 51; July, 1954. 

39 W. Edwards, 
Work on Decision Making,” 
Econometrica. 

40S, Vail, “Alternative calculi of subjective probabilities,” in 
“Decision Processes” (R. M. Thrall, G. H. Combs, and R. L. Davis, 
eds.); John Wiley & Sons, Inc., New York, N. Y.; 1954. 

4.1. J. Fogel, “On the Design for an Optimal Training Strategy,” 
Convair Rep. ZG-8- 024; October 9, 1956. 

2 WW. Edwards, “An Empirically Oriented Model for Decision 
Making,” Lab. Note AEPRL-LN-55-10, Air Force Personnel and 
Training Res. Center, Lowry AFB, Denver, Colo.; October 7, 1955. 

43, W. P. Tanner, jr., “Psychophysical Application of the Theory 
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form a conceptual model which includes the fundamen- 
tal decision-making operation. Such a model would 
serve a dual purpose. It would provide a means for the 
prediction of human behavior in proposed environ- 
ments and it will, in itself, become the fusing link to 
bind together the work which has simultaneously been 
carried on in neurophysiology“. biophysics,“*** and 
psychology.*?»>° 

Methods of analysis can be most fruitful if they at- 
tempt to unite the thinking and previous findings in 
related fields of interest. The present state of the art 
provides new tools for the fabrication of such a model. 
If this step can be accomplished, it will offer a distinct 
advantage to all the contributing fields. Engineering 
will emerge with a new synthesis technique for cockpit 
design. One which will optimize the environment for the 
human decision maker. 


APPENDIX [ 


SoME SySTEM FUNCTION ATTRIBUTES OF MAN 
AS COMPARED TO MACHINES 


The following tabulation will be categorized by sys- 
tem function properties, listing those in which the ma- 
chine is usually superior first, then considering those in 
which the human excels. Since these are system func- 
tions, the human properties will be predominantly psy- 
chological, describing aspects of the human transduc- 
tion of information. This is not an attempt to be com- 
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plete or to paint any black and white picture in any 
dimension; rather, it is the purpose of this Appendix to 
indicate the type of thinking indigenous to human engi- 
neering which maintains a proper perspective in the ap- 
plication of biotechnology to actual hardware systems 
design. 


Machines Excel in the Following Functions 


In handling of high inertia components or smaller 
masses over longer periods of time a machine can be de- 
signed to tolerate higher imposed forces than the human. 
So it is that missiles may be guided through more aero- 
dynamic rigors than could be accomplished with a 
manned aircraft. Aside from the sheer physical abilities, 
the machine is superior in the reliability of repetitive 
functioning. In such operations fatigue is usually only 
a secondary consideration. The machine does not suffer 
trom “boredom” or other subjective qualities. For exam- 
ple, it remains “unconscious” of its environment and so 
performs consistently with the programming regardless 
of imposed “distractions” or dangers to survival and, in 
general, this is as it should be since the machine is more 
expendable than the man. By proper design, a machine 
can be made to have almost immediate response. This 
could be a distinct advantage over the unremovable 
human reaction time latency in particular applications. 
It can transduce information with a channel capacity 
which can be made arbitrarily large and such large 
inputs can be effectively stored in a precise but short- 
term memory which is superior to the human ability. It 
can utilize these data in the solution of extremely com- 
plex problems at rates far in excess of anything a man 
could accomplish. 


Man Excels in the Following Functions 


In pattern recognition man excels in the ability to 
filter “noise” from randomly presented data and identify 
a signal structure in the given data. In fact, such struc- 
ture is postulated even when the subject is given truly 
random pure noise.'® This ability is common to both the 
spatial and temporal domains and is dependent upon 
the remarkable human correlative memory and axes 
transformation capability. This latter characteristic 
may be illustrated by human observation of a two-di- 
mensional pattern as representation for a three-dimen- 
sional object which can then be mentally “viewed” from 
any desired direction. The above-referenced time do- 
main filtering also allows for the establishment of a 
knowledge of the sequential dependencies. This, in it- 
self, is sufficient information to allow of self-reprogram- 
ming to account for transient and nonstationary char- 
acteristics in the perceived data. In fact, it would prove 
extremely costly to build a device which is so well suited 
to the monitoring of low probability events. This is true 
in any single dimension and becomes even more im- 
pressive when the human ability to receive information 
by any of a diverse set of multimode sensors. These can 
operate at very great sensitivity. Ordinary equipment 


Fogel: The Human Computer in Flight Control 


201 


does not compare in either the number of available 
sensory modes or the visual sensitivity which is avail- 
able; however, it is still possible to build special purpose 
devices which will surpass the human in these respects 
provided the cost and time required are available. Some 
of the channels are particularly suited to the sensing of 
information which warns of danger and these “handy” 
channels, although not in direct use, couple to the re- 
programming ability to offer great flexibility and re- 
sultant reliability in dealing with unexpected circum- 
stance. He can accomplish the same purpose with a dif- 
ferent approach. Complex equipments utilize redundant 
design which increases reliability, but at an exponential 
cost in weight and number of components. It is also ap- 
parent that the human operator is not subject to jam- 
ming by any of the ordinary ECM techniques, and in 
fact his spectral filter characteristics allow his detection 
of masked signals taken from radar or sonar receivers. 
Usually the man is required to take some continuous 
corrective action based upon his acquisition of a target. 
Here the machine can prove superior in tracking except 
for the variable weighting which the human operator 
can apply to displacement error, rate of error, accelera- 
tion of error, and other nonlinear properties should they 
become desirable to stabilize the closed loop. Such non- 
linearities prevent system overload and, when it is 
properly motivated, the human can exhibit extraordi- 
nary properties which can serve to compensate for in- 
adequacies of the controlled system. Certain absolute 
limits cannot, however, be exceeded. For instance, the 
channel capacity for the transduction of information 
sets a breakdown point beyond which the human can be 
pressed. Even within these limits his mental computa- 
tion is weak and relatively inaccurate. He cannot be ex- 
pected to follow an optimal theory of games solution, 
although in any real world complex situation his solu- 
tion will probably prove closest to that desired optimal 
since a computed solution cannot always be obtained. 
To conclude, it may be stated that the human operator 
is relatively light in weight, and relatively easy to main- 
tain. When given a well-designed cockpit he is in good 
supply and relatively inexpensive to produce. 


APPENDIX I] 
Tue ANTICIPATOR-MEMORY MODEL 


A simple model for the estimator or anticipator can be 
determined from certain logical hypotheses concerning 
the expected transformations of the moments. The un- 
certainty of the outputemust be some direct function of 
both the time interval of projection, as well as the un- 
certainty of the input. Let x, y, and N represent the in- 
put, output, and noise variable of the estimator. 


Hypotheses: 


1) That the mean value of the output random vari- 
able, m, is equal to the mean value of the input 
variable, mz. 
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2) That the variance of the output random variable, 
oy’, is equal to the variance of the input random 
variable, 77, increased by a factor proportional in 
some manner to the estimation or anticipation 
time interval, a. 

3) That the skewness of the output random variable, 
ny, will usually be some decreasing function of the 
estimation or anticipation time interval, a. 

4) That the added noise of estimation or anticipation, 
N, is independent of the input variable, x, but has 
the same moments of the input variable with the 
exception of the mean value which is zero. In this 
manner, the noise which is added is in itself di- 
rectly dependent upon the indefiniteness of the 
input random variable. 


These required hypotheses may be fulfilled by a simple 
time domain model 


y= x«— kalN, RO: (1) 


In graphic form, this equation defines a circuit as shown 
in Fig. 2. From this model it may be seen that 


My = MM, — Mn’ (2) 
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Fig. 2—Time domain model for the estimator of anticipator element. 


Due to the hypothesized independence of N and x, 


an = 0. (7) 
Further, 
on’? = k?o?cy? = k?a?o,”, (8) 
so that 
oy? = (1 + k?a*)o,? (9) 


ny = Elx* — 3kaNx? + 3k202N2% — koAN8], (10) 


but my =0 so that 


Ny = nz + 3k?a®on?mz — Rea ny. (11) 
where So long as 

mn = kamy (3) Nz nN 
: ae OKO Mts (12) 

but, by hypothesis Oz on? 
myn = 0 (4) is anticipated, a monotonically decreasing function will 

result. 
so that The value of this model appears to be its simplicity 
errr (5) and its intuitive agreement with some psychophysical 
c evidence which concurs with most of the usually identi- 
oy? = 0,” — Lazy + on’. (6) fied aspects of the process of estimation or anticipation 
CORRECTION 


Velio A. Marsocci, author of “An Error Analysis of 
Electronic Analog Computers,” which appeared on 
pages 207-212 of the December, 1956 issue of these 
TRANSACTIONS has requested the editors to make the 
following corrections to his paper: 

Eq. (42) should read 


Sao Se 7B »s: BSn'] 


: Sper a” BiSni 1 = 
T2[mSn™ + >> B:(iS,)*] + 2Sn" + D1 BsSn') “ CiSa) 
21m ai 1 oa cus 
To 


and the statement following (30) should read, 
“... equivalent to saying the X,no=5S,.” 
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A Method for Evaluating Amplifier 
Phase Shift at Low Frequencies* 


Consider the circuit configuration using 
ideal components shown in Fig. 1. The open 
loop transfer function for this circuit is: 


LAs 


Fig. 1 


W(S) = — 1000/S?. 


The characteristic equation for the closed 
loop system then is: 


S? + 1000 = 0. 


Examination of the roots of the above func- 
tion indicates that at S=j10./10, the sys- 
tem has an undamped resonant frequency at 
w =31.6 radians. 

A practical operational amplifier will 
have some small but finite phase shift and 
attenuation at this frequency. Attenuation 
will result in a change in the w, while a small 
phase shift will primarily introduce an ex- 
ponential decay or increase in the amplitude 
of the sinusoid. 

If the expression for the open ioop trans- 
fer function is developed for a practical sys- 
tem of the type above, where integration 
approaches the ideal (see Appendix), and 
the summing amplifier has a small lagging 
phase shift, then 


The characteristic of the closed loop sys- 
tem is: 
S?(1 + 7S) + 1000 = 0 
7S? + S? + 1000 = 0 
1 1000 
53+ — $24 ——=0 
T Y fs 


which is a cubic of the form: 
S§+ aS? + 6S +¢=0. 


It is evident that the boundary condition be- 
tween stable and unstable roots occurs when 
ab=c. For ab>c, the system oscillates with 
an exponentially decreasing amplitude and 
for ab<c, the system oscillates with an ex- 
ponentially increasing amplitude. 

Now, if the characteristic of the system 
can be altered such that ab =c, the correction 
will be a measure of the phase shift of the 
summing amplifier. Such a circuit is shown 
in Fig. 2. The transfer function for the cor- 
recting circuit (II) is: 

10¢; aeo 


6 = — —— — 


S S) 
so that 


* Received by the PGEC, May 13, 1957. 
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We then have 
— 1000 


WASH SET EGS 


and the characteristic is: 
S(a + S)(1 + 7S) + 1000 = 0. 
Simplifying, we obtain 
ta + 1 


T 


1000 
= 0 


T 


+ 


a 
S+ost 
Li 


The requirement that the coefficients satisfy 
the relation ab=c gives us 


For a typical amplifier with a gain of 1, 7 is 
of the order of 81075. 

Substituting this value of 7 in the above 
equation we obtain a function of the follow- 
ing form: 


—X + /X*+A = f(a) 
where A is a small increment. Now let 
JX?*+A=X4+o. 
Then 
X?+ A= X2?+ 2X6 + o?. 


To a first approximation o? may be neg- 
lected and therefore c=A/2X. 

Substituting back into the equation for 
a, we have for the positive root 


1 1 
a = ——+— + 10007 & 10007 
hg Nie 
and for small phase angles 6 


wa 7 
6 = tan lwr wr = —— radians. 


1000 


Since w=2zf and w radians equal 180 de- 
grees, we obtain 


9 
= bBo degrees. 


This approximation is useful for system 
gains (K) up to 50105, so that the general 
formula 


wat 360 fa 
6 =—rad or #§ = —— degrees 
K K 


is valid within the range of K’s encountered 
for which this method of measurement is 
useful. 
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APPENDIX 


The following analysis will show that in 
the range of summing amplifier phase shift 
of 0.02° to 0.0003° and system frequencies of 
2.5 to 90 radians per second, integrator error 
is negligible and the measured values of 
summing phase shifts are accurate within at 
least 1 per cent. 

The circuit shown in Fig. 3 may be used 
to analyze both the integrator and summing 
amplifiers where A exceeds 50,000 for a good 
operational amplifier. If we apply the per- 
formance equation! for a parallel feedback 
amplifier, the transfer function F for the 
circuit of Fig. 3 is 


{| 


Fig. 3 
Ri + S72) 


RL + Sr) 

where 72= R2C2 and 71= RiCh. 
For a summing amplifier let K4=Ri/R2 
where K,4 is the amplifier gain factor. Then 


K 5 
F(jw) = a ee (1 + w*r72 + jo(r2 — 71). 
The phase angle is given by 
tan 0 = ae ral 
1 + wr172 


and since w?ri72 is small 

0=tanz! w(t2—71) —wR2(C2—-K4GQ). 

For a gain of unity and a range of C;—C; 
from 2 to 8 pyf at w=31.6 radians, @ will 
range from 0.0036 to 0.0145 degrees. Higher 
gains will increase the phase shift. 

For an integrator 7,>>72. Typical values 


are 71=10%, w=2X10%. The integrator 
phase shift error is given by 
1 2 1 
1) =Vieyele seo) a ( + wr) 
«(Te at 71) WT1 
for 71> To. 


The term w7» is insignificant with respect 
to summing phase shift since at w=31.6 the 
contribution of this term is 0.000057° (for an 
integrator gain of 10). Higher gains will re- 
duce this error proportionately. This com- 
pares with a typical summing phase shift of 
0.007° (for a gain of 10). The gains and fre- 
quencies are those used in the system de- 
scribed in the body of this report. 

The term —(1/w71) becomes significant 
when w approaches 2.23 radians at which 
time we have B=6/10 (assuming gains 
throughout the system approach 1). 

H. HAMER AND A. LUPINSKI 

Electronic Associates, Inc. 

Long Branch, N. J. 

1 Korn and Korn, “Electronic Analog Computers,” 


McGraw-Hill Book Co., Inc., New York, N.Y. 2nd 
ed., sec, 4.2; 1956, 
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High-Speed Digital Multiplication* 


In a recent note! Estrin, Gilchrist, and 
Pomerene showed how carry-storage could 
be usefully combined with carry-propaga- 
tion-detection circuits to produce very fast 
binary multipliers. The present note is in- 
tended to introduce a new method (tenta- 
tively named the “Modified Short-Cut” or, 
“MSC” multiplication process), which when 
combined with carry-propagation-detection 
circuits, produces equally fast or even faster 
multipliers. This new method is more com- 
pletely developed, analyzed, and described 
elsewhere.?3 

The decimal short-cut multiplication 
method as used on desk computers is well 
known and its analog may be similarly used 
in binary arithmetic units. The process 
which, for example, expresses a sequence of 
“ones,” Doe 2ras (2+! —2™) is however less 
efficient than a straightforward multiplier. 
Thus for an (m-+1)-bit signed multiplier it 
requires, on the average, (m+1)/2 addition 
or subtraction operations (henceforth termed 
“operations”) whereas the latter requires 
only m/2 additions. This inefficiency arises 
from multiplier-bit combinations of the 
form ---0100--+ and ---1011--~-, that 
is, “isolated” bits. If the former combination 
occurs ina positive multiplier, for example, a 
straightforward multiplication requires only 
one addition of the multiplicand to the par- 
tial sum whereas a short-cut method per- 
forms a subtraction followed by a shift and 
an addition. Similarly when the second com- 
bination arises in a positive multiplier, a 
short-cut method demands two operations, 
whereas it is easily seen that a single sub- 
traction would suffice. Similar inefficiencies 
arise when a negative multiplier represented 
in either “ones” complements or “comple- 
ments to two” is controlling the multiplica- 
tion. Recognition of these facts has led to the 
development of the MSC process in which a 
standard short-cut procedure (which “oper- 
ates” whenever neighboring bits are un- 
equal) is used except when “isolated-bits,” 
appropriately defined, are encountered. 
When this occurs, then for positive or nega- 
tive multipliers respectively, isolated ones 
lead to addition or subtraction and isolated 
zeros to subtraction or addition. A study of 
the process shows that it lends itself very 
easily to mechanization. 

The method may be formalized by con- 
sidering a ternary coding of binary numbers, 
such that 


m+1 


2 YS bt = 2 DY (—1)8C;2# =~ (1) 
0 0 


where c; and S; are binary variables. Any 
multiplication method based on such a re- 
coding will perform an operation in any cycle 
tin which the controlling bit is b;and in which 
(c:=1). The sign of this operation is con- 
trolled by S:, an addition being performed 
when S;=0. 


* Received by the PGEC, March 15, 1957; revised 
manuscript received, June 20, 1957. 

1G. Estrin, B. Gilchrist, and J. H. Pomerene, “A 
note on high-speed digital multiplication,” IRE 
TRANS., vol. EC-5, p. 140; September, 1956. 

2M. Lehman, “Parallel arithmetic units and their 
control,” Ph.D. thesis, Univ. London, February, 
1957. 

3M. Lehman, “Short-cut multiplication and di- 
vision in automatic binary digital computers with 
special references to a new multiplication process,” 
submitted for publication to Proc. IEE. 
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The MSC process may then be defined 
by expressions: 


Ce = (br FH Bea) KE (2) 
St = (bis & by)v [dey # bt) & sea] (3a) 
= (er & bijs)v (& & se) (3b) 


In these expressions b, (¢<0) is implicitly de- 
fined in a manner which depends on the 
negative number representation used. 

Eqs. (2) and (3a) follow immediately 
from the modification of the standard short- 
cut methods as outlined. Eq. (3b) may be 
obtained from an alternative consideration 
of the process or by an application of the 
appropriate algebra from (2) and (3a). 

The value of S; is clearly of no conse- 
quence when ¢;=0, 7.e., when c.=1, and for 
a mechanization of the process a more con- 
venient (though not equivalent) form of 
(3b) is 


St = best. (4) 


Tocher! has considered the most general 
relations governing ternary recodings of 
binary numbers of the type of (1) and shows 
by a proof a modified version of which is re- 
produced by Lehman? that the MSC proc- 
ess may be considered the optimum multi- 
plication process (in a sense to be defined) in 
asynchronous parallel binary machines or in 
synchronous machines in which multiplica- 
tion may be allowed to take a variable num- 
ber of word (or bit) times. For such ma- 
chines the optimum process is that which 
minimizes the number of operations for a 
given number length, that is, one that mini- 
mizes > ~ ct. 

It is further shown by different methods 
by both Tocher‘ and Lehman? that the aver- 
age number of operations when using the 
MSC process with an m+1 bit (signed) 
number is 


$1 3m + 4— [9 — (—1)" |G} (3) 


and for the more usual values of m this ap- 
proximates to m/3. Moreover, from (2) it 


follows immediately that cz & c,1=1; that 
is, that operations can never be required in 
two successive cycles. Thus the maximum 
number of operations required is [(m-+2) /2] 
and this is approximately equal to the aver- 
age number required in straightforward mul- 
tiplication. In any cycle in which an opera- 
tion has occurred, it is thus possible to con- 
clude that cycle with a two-place shift back 
of the partial sum and the multiplicand, in- 
stead of the more usual single-place shift. 
This in turn implies that the actual average 
multiplication time (exclusive of store ac- 
cess) may be reduced by about 30 per cent. 
If such two-place shift-links are provided it 
is possible to further simplify the controlling 
network based on (2), to 


Ce = be A di. (6) 


It is shown further?:+ that the MSC 
process, as defined, is immediately applica- 
ble to signed multiplication irrespective of 


_ 4K. D. Tocher, “Technique of multiplication and 
Seay. for automatic binary computers,” (in prepa- 
ration). 
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whether “ones” complements or “comple- 
ments to two” are used for negative number — 
representation. Naturally the addition cir- 
cuits must be matched to this representation, 
This implies that when “ones” complements 
are used for negative number representation, 
provision must be made not only for end- 
around carry but if double-length or un- 
rounded single-length products are required, 
either a double-length accumulator or some 
other simple circuit modification must be 
provided to prevent the possible introduc- 
tion of an error whenever the operation and 
hence the partial product changes sign. 

A detailed comparison of the speeds and 
hardware requirements of the various mul- 
tiplication processes is difficult since the 
relative performances are very much de- 
pendent on circuit designs and circuit 
speeds. An attempt has, however, been 
made?’ to assess and compare the relative 
average speeds of the carry-storage system, 
the MSC system with two-place shift links, 
the MSC system with only single-place 
shift links, a straightforward multiplication 
method, and finally a combined MSC carry- 
storage multiplier. General expressions in 
terms of the response speeds of various parts 
of the circuits and actual times based on as- 
sumptions about these speeds are quoted for 
a variety of hypothetical machines which, in 
some cases, are assumed to include carry- 
detection circuits.® 

In particular, one set of figures relates to 
the times quoted by Gilchrist, Pomerene, 
and Wong.® 

And, the figure given for multiplication 
based on carry storage was originally 8.2 
usec. Further consideration’ of Gilchrist’s® 
figures has revised this estimate since the 
delay obtained from one carry network stage 
appears to be 0.120 usec and not 0.045 usec 
as originally quoted. In any case it is difficult 
to see how Estrin e¢ al.’ arrive at a figure of 
6.4 ysec. Total average multiplication time 
in the unit described by them will surely be 
of order 41 0.15+40 0.12 +0.21=11 psec 
and this is actually slower than the conven- 
tional multiplier.* By making the carry regis- 
ter a shifting register this average time may, 
of course, be reduced to 410.15+20 0.12 
+0.21=8.8 usec, since the addition of car- 
ries need then be performed only in those 
cycles in which the multiplier bit is signifi- 
cant. Comparable figures for the MSC proc- 
ess applied to a unit using carry-detection 
circuits are 7.0 ysec if additional two-place 
shift links are provided and 9.0 usec if only 
the normal single-bit links exist. 

This analysis is, however, only based on 
Gilchrist’s figures and it might well be that 
with certain types of circuit elements the 
carry-storage process is faster and more ap- 
propriate. An example is a synchronous cir- 
cuit based on (serial type) bit-synchronous 
circuit elements in which each such element 
involves a delay of an integral fraction (say 
x or 1) of a bit time. This might occur for 
example in applications of magnetic core 
elements or where circuits designed for serial 
use are to be utilized in the construction of a 
parallel machine. 


5 B. Gilchrist, J. H. Pomerene, and S. Y. Wong, 
“Fast carry logic for digital computers,” IRE TRANS., 
vol. EC-4, pp. 133-136; December, 1955. j 
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Finally, it should be added that the mul- 
tiplication methods based on carry-storage 
-and on the MSC process are not, of course, 
mutually exclusive. In a combined system 
it would clearly be desirable to make the 
-carry-store a shifting register, so that the 
carries would be added in only in those 
cycles of multiplication in which an addition 
or subtraction (obtained by complementing 
the multiplicand register) of the multipli- 
.cand was also required. An estimate of the 
speed of the resultant multiplier, based on 
-Gilchrist’s figures® shows that times of 6.1 
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and 8.0 ywsec would be obtained according 
as to whether the unit was or was not 
provided with two place shift links. The 
latter figure is greater than that obtained for 
the faster MSC unit; hence, it is clear that 
the combined system would only be used in 
a machine already equipped with two-place 
shift links. The resultant arithmetic unit 
would be some 25 per cent larger than one 
multiplying by the fast MSC process and 
would yield a 13 per cent increase of speed. 
This resultant 6.1 usec average multiplica- 
tion time is of the same order as the ac- 
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cess time of presently envisaged high- 
speed (magnetic-core) stores; and it is there- 
fore considered that with present day circuit 
techniques, this combined “Carry-Storage 
MSC Multiplier” with or without carry- 
detection is not worthwhile. 


M. LEHMAN 

Ministry of Defence 

Tel Aviv, Israel 

Formerly with Computer Lab. 
Ferranti Ltd. 

London, England 
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PGEC News 


Joint COMPUTER CONFERENCE 
PROCEEDINGS AVAILABLE 


A few copies of the Proceedings of 
past Joint Computer Conferences are 
still available from the IRE Head- 
quarters, 1 East 79th Street, New 
York 21, N. Y. A list of available 
Proceedings and their prices appears 
below. Orders should be accompanied 
by remittances payable to the Insti- 
tute of Radio Engineers. 

1952 Review of Electronic Digital Com- 
puters (covering the Decem- 
ber, 1952 Conference) $3.50 

1954 Proceedings of the Eastern Joint 
Computer Conference $3.00 

1955 Proceedings of the Eastern Joint 
Computer Conference $3.00 

1956 Proceedings of the Eastern Joint 
Computer Conference $3.00 
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FELLOWSHIP SPONSORED BY PGEC 


The National Academy of Sciences-Na- 
tional Research Council has announced the 
awarding of a predoctoral fellowship to 
Eugene Walter Henry, presently with the 
United States Air Force at Dayton, Ohio. 

This fellowship is sponsored by the Pro- 
fessional Group on Electronic Computers of 
the Institute of Radio Engineers and is ad- 
ministered by the NAS-NRC. It is awarded 
to an outstanding young scientist to con- 
tinue graduate training in electronic com- 
puters. 

Mr. Henry was born in Wichita Falls, 
Texas, in 1932. He received the B.S.E.E. de- 
gree magna cum laude from the University of 
Notre Dame in 1954, and the M.S.E.E. de- 
gree in 1955 from the same university. He 
majored in electrical engineering with a 
minor in electronics. Since graduation he has 
been on active duty in the Air Force as a 
lieutenant, assigned to the Communication 
and Navigation Laboratory, Wright Air 
Development Center, Dayton, Ohio. His 
tour of duty ended in June, 1957. 

He plans to pursue his fellowship in the 
Department of Electrical Engineering at 
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Stanford University (California), beginning 
in September, 1957. His present program of 
study involves advanced training and re- 
search in servomechanism electronics and 
will include electronic computer theory and 
advanced network theory to facilitate servo- 
system solutions. He will be working toward 
the Ph.D. degree, but his long-range goal is 
“to build, with continued study and research 
in industry or universities, systems with su- 
perior operational and environmental char- 
acteristics.” 


CHAPTER NEWS 
Washington, D. C. 


The following officers have been elected 
for 1957-1958: 

Chairman, R. G. Lilly, Bureau of Ships, 

Navy Department 

Vice-Chairman, L. D. Whitelock, Bureau 

of Ships, Navy Department 

Secretary, B. J. Ellis, Department of De- 

fense. 

Present plans call for five meetings in 
1957-1958, to be held on the first Wednesday 
of October, November, February, March, 
and May. 


Chicago 


This chapter has no secretary, and the 
name of H. E. Kantner was listed in error in 
the March, 1957 issue. 


COMPUTER SYMPOSIUM 


The AIEE Feedback Control Sytems 
Committee with participation by the IRE 
Professional Group on Automatic Control 
and the ASME-IRD is organizing a sym- 
posium on the theme of “Computers in Con- 
trol” at the Chalfonte-Haddon Hall Hotel in 
Atlantic City, N. J., on October 16-18, 1957. 
The symposium will emphasize the use of 
digital and analog computers both as ele- 
ments of feedback control systems and as 
utilized in the design of such systems. 

Some 35 technical papers by leading 
scientists in this country and by Prof. J. 
Tsypkin of The Academy of Science, Mos- 
cow, U.S.S.R., Dr. M. Pélégrin of The Min- 
istry of Defense, France, and Dr. Blackman 
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of The Imperial College of Science and 
Technology, London, England will be pre- 
presented. 

A portion of the papers to be presented 
at the conference are available in preprint 
form from the AIEE; the Proceedings of the 
Conference will be published by the AIEE 
early in 1958. Conference arrangements 
have been made by a committee consisting 
of Harold Chestnut of GE, E. W. Grabbe, 
Ramo-Wooldridge, Adam Kegel, Westing- 
house, John Ragazzini, Columbia Univer- 
sity, and E. Mishkin and Chairman J. G. 
Truxal, both of Polytechnic Institute of 
Brooklyn. 


PGEC FELLOWSHIP 


For the second time, the PGEC will 
sponsor an annual Fellowship for graduate 
study in computing. The amount of the 
stipend will be “2,000.00, plus tuition not to 
exceed “1,000.00. 

This Fellowship will be administered 
through the Office of Scientific Personnel of 
the National Academy of Sciences, and the 
selection of the successful recipient will be 
made by that office. There will be no restric- 
tions as to the university or college to be 
attended, but it will be necessary for the 
Fellow to specialize in computing or a closely 
allied field. 

Applications for this Fellowship will be 
received through January, 1958, and should 
be addressed to: 


Fellowship Office 

Office of Scientific Personnel 
National Academy of Sciences 
2101 Constitution Avenue, N.W. 
Washington 25, D. C. 


Announcements made by the National 
Academy of Sciences will not mention this 
Fellowship by name but will merely indicate 
that the National Academy Fellowship Pro- 
gram has available a number of fellowships 
of which this is one. The PGEC is publiciz- 
ing this Fellowship directly through its own 
TRANSACTIONS, the IRE StupENT QuaR- 
TERLY, PROCEEDINGS OF THE IRE, and 
through each PGEC Chapter. 

RicHARD W. MELVILLE, Chairman 
Student Activity 
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| Reviews of Current Literature 


Copies of books or of articles to be reviewed should be sent to H. D. Huskey, Depart- 
ment of Electrical Engineering, University of California, Berkeley, California. The 
editors wish to express their gratitude to the reviewers who, through their efforts, make 
this section possible-—H. D. Huskey. 
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57-85 
The Astonishing Computers—William B. 
Harris. (Fortune, pp. 136-139, 292-298; 
June, 1957.) The computer business is ana- 
lyzed by the author with a description of 
digital computer manufacturers and the 
diverse use of their machines; simulation of 
jet fleet operations, scheduling of product 
shipping, predicting labor, material and 
‘parts requirements, optimizing oil refinery 
‘operation, and others. The problems that 
these computer manufacturers have and 
what they are doing about them, for exam- 
ple, how each of the large manufacturers is 
handling such problems as selling, financing, 
‘obsolescence, and manufacturing, are dis- 
cussed along with current and future mar- 
kets for computers. 
| J. A. Fingerett 


57-86 

A Survey of Domestic Electronic Digital 
Computing Systems, PB 111996—Martin H. 
Weik. (Reprint of Ballistic Res. Lab. Rep. 
No. 971, U. S. Dept. of Commerce, Office of 
Tech. Services, Washington, D. C., vii+272 
pp.; 1956.) It is certainly not easy to remain 
abreast of developments in the electronic 
computer field. This survey helps to bring 
up-to-date (end of 1955) a broad picture of 
the field in the United States. Previous 
surveys of a similar nature date back to 
1953 and are now obsolescent. Eighty-four 
“Domestic Electronic Digital Computing 
Systems” are described in the report. Two 
foreign manufacturers, Ferranti and Olivetti, 
are represented, presumably because these 
companies have U. S. sales organizations. 
On the other hand, at least some U. S. 
coniputers are missing, for example Harvard 
Mark IV, Univac 120, and Untvac File 
Computer. It would be highly desirable if all 
foreign computers could be added to the list 
together with annual supplements. The de- 
scriptive information on each system runs 
from 2 to 4 pages and generally includes 
photographs, manufacturer, user(s), arith- 
metic and logical organization, size, cooling 
and power, input-output and memory data, 
production record and price, and operating 
experience. Much of the information was 
obtained from manufacturers and users. For 
this reason, as the editor points out, care 
must be taken when comparing detailed 
minute points since the contributers may 
have used different frames of reference. Any- 
one considering the acquisition of a com- 
puter could use the information in the survey 
to select a small group of computers for fur- 
ther consideration. The survey would be 


very useful for familiarization purposes. A 
chapter on Analysis and Trends follows the 
system description. The machines are listed 
in a number of ordered tables according to 
the characteristics of word length, add time, 
memory capacity, memory access time, tube 
and diode quantities, power requirements 
and cost. In addition the editor gives his 
opinion of trends in the field. A brief bibliog- 
raphy and a glossary of computer terms are 
included. (See 57-87, this issue.) 
Douglas L. Hogan, 
Courtesy of Mathematical Tables and 
other Aids to Computation 


57-87 
A Second Survey of Domestic Electronic 
Digital Computing Systems—Martin H. 
Weik. (Ballistic Res. Lab. Rep. No. 1010, 
Ballistic Res. Labs. Aberdeen Proving 
Ground, Md., 453 pp.; June, 1957.) One 
hundred and three computer systems are 
described in this report. Each system is de- 
scribed with respect to some sixteen head- 
ings. These headings were chosen to provide 
a measure of quality of the various systems 
and to indicate the position for those ma- 
chines which are commercially available. 
The information is compiled from data sup- 
plied by manufacturers and, as the author 
is quick to admit, it is somewhat difficult 
to be sure that one has a valid picture in all 
cases. Various tables are given in an attempt 
to compare the characteristics of the com- 
puter systems. The tables include a list of 
manufacturers, number of systems produced, 
word length, operation times, memory 
access times and capacity, tube, crystal and 
transistor quantities, power requirements, 
and approximate cost. The power of the 
various computer systems is poorly indi- 
cated by such figures as memory access time, 
or arithmetic times. The reviewer would 
prefer to see the times required to solve by 
elimination, say, a system of linear equa- 
tions of a given order both using fixed point 
arithmetic and floating-point (programmed) 
arithmetic. The number of systems using 
various methods of checking are sum- 
marized, and somewhat more academic 
figures are given such as the number of 
tubes per kilowatt and the price per tube for 
systems. This report is the best source for 
acquiring a picture of the present state of 
automatic computers in U.S.A. This report 
supersedes BRL Report No. 971 (see 57-86, 
this issue). 
H. D. Huskey 


621-32 :621.9 57-88 

Machine Tool Control—C. K. Marklew. 
(Elect. Rev., Lond., vol. 159, pp. 189-193; 
August 3, 1956.) This is a brief survey of 


electronic control systems using punched 

tape, cinematograph film, magnetic tape, 
photocell devices, etc. 

Courtesy of Proc. IRE 

and Wireless Engineer 


57-89 
La Tecnica Britannica nel Campo delle 
Calcolatrici Elettroniche Automatiche Alla 
Luce del Recente Congresso di Londra— 
Paolo Ercoli, Giorgio Sacerdoti, and Roberto 
Vacca. (Ricerca Sci., vol. 26, pp. 2321-2339; 
1956.) This is an account of a series of visits 
to the computing laboratories of England 
with very brief descriptions given of a half- 
dozen large scale computers. 
D. H, Lehmer 
Courtesy of Mathematical Reviews 


57-90 
Analog Versus Digital Techniques for 
Engineering Design Problems—D. B. Bree- 
don. (IRE Trans., vol. IE-4, pp. 86-89; 
March, 1957.) Nearly every problem en- 
countered in engineering at some time pro- 
ceeds from the qualitative to the quantita- 
tive phase where the results of mathematical 
analysis must be applied in actual computa- 
tion. Most often the computation is short 
enough that automatic means are not 
necessary. However, more and more prob- 
lems are requiring powerful aids to calcula- 
tion. This increase is due as much to ex- 
panded thinking encouraged by the mere 
availability of computers as to any actual 
backlog of work. Therefore it is to the engi- 
neer’s advantage to know what computers 
can do for him, even though he may take 
his problem to someone else for final prepa- 
ration and programming. The following text 
presents some examples in which automatic 
calculation is being used. The logic used in 
choosing the computing methods is shown 
based on the characteristics of problem and 
computer. As background for the examples 
the most important of these characteristics 
is presented briefly in the next section. 
Courtesy of Proc. IRE 


681.142 57-91 
Industrial Data-Reduction and Analogue- 
Digital Conversion Equipment—P. Partos. 
(J. Brit. Inst. Radio Eng., vol. 16, pp. 651— 
678; December, 1956.) A review of typical 
system specifications is presented and sev- 
eral existing and proposed installations are 
described. 
Courtesy of Proc. IRE 
and Wireless Engineer 
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621-52: 681.142 57-92 
Ship Stabilization: Automatic Contrcls, 
Computed and in Practice—J. Bell. (Proc. 
IEE, Part B, vol. 104, pp. 20-26; January, 
1957.) Predictions by step-by-step and analog 
methods are given, the functioning of the 
analog computer being described, and exam- 
ples of results presented. Some practical 
results from sea experience and a. brief 
account of a stabilizing demonstration on a 
model are included. 
Courtesy of Proc. IRE 
and Wireless Engineer 


ANALOG COMPONENT 
RESEARCH 


57-93 
A Multipurpose Electronic Switch for 
Analog Computer Simulation and Autocor- 
relation Applications—N. D. Diamantides. 
(IRE Trans., vol. EC-5, pp. 197-202; De- 
cember, 1956.) A system of four diodes in a 
series-parallel connection is combined with 
de operational amplifiers in order to ac- 
complish a variety of computational opera- 
tions. The diode circuit is equivalent to a 
SPST switch survey or a voltage pulse. 
When inserted in series with the input of an 
amplifier or an analog memory, the switch 
makes possible waveform sampling or wave- 
form quantizing of the input voltage. Other 
functions, such as the fast discharge of an 
integrator, are also achieved. A very signifi- 
cant application of the diode switch in 
computer circuitry is its use in combination 
with a multiplier and a storer (a bank of 
integrators) in order to obtain autocorrela- 
tion or cross-correlation of messages after 
they have been translated into voltages. A 
commutator or a ring counter is employed 
to provide the switching pulse. The correla- 
tor has the advantage of generating the cor- 
relation function concurrently with the 
message without necessitating previous re- 
cording and repeated playback. 
Courtesy of Proc. IRE 


631.142 :621.383 57-94 
Photoformer Analysis and Design—E. 
Elgeskog. (Chalmers tek. Higsk. Handl., no. 
172, p. 40; 1956.) Analysis is presented per- 
mitting the design of a photoformer with a 
bandwidth of several kc, suitable for use ina 
high-speed repetitive electronic differential 
analyzer. Difficulties due to the short re- 
sponse time are discussed in detail. Results 
obtained with an experimental system using 
a plane cr tube screen and photocathode are 
in good agreement with the theory. 
Courtesy of Proc. IRE 
and Wireless Engineer 


ANALOG EQUIPMENT 


681.142 57-95 

The Design and Applications of a Gen- 
eral-Purpose Analogue Computer—R. J. A. 
Paul and E. L. Thomas. (J. Brit. IRE, vol. 
17, pp. 49-73; January, 1957.) The design 
and construction are considered in detail 
with particular emphasis on amplifier gain, 
bandwidth, and phase shift. A computer 
whose design is based on this analysis and 
has some novel features is described. Its use 
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on a variety of problems illustrates its wide 

range of application. (See 56-169, December, 
1956 issue.) 

Courtesy of Proc. IRE 

and Wireless Engineer 


681.142 57-96 
Radioactive-Fall-Out Computer—(Elec- 
tronic Ind. and Tele-Tech., vol. 15, pp. 57, 
136; September, 1956.) Electronic analog 
techniques are used in a new computer to 
make rapid predictions of fall-out based on 
wind velocities and particle sizes. (See 57-7, 
March, 1957.) 
Courtesy of Proc. IRE 
and Wireless Engineer 


681.142 57-97 
A New Computing Method using High- 
Frequency Currents—H. J. Uffler. (Ann. 
Radtoélect., vol. 11, pp. 187-199; July, 1956.) 
An electromechanical process is described 
for performing algebraic operations in analog 
computers. The system operates at 472 kc 
and comprises only passive components. 
Considerable accuracy and _ stability are 
achieved. 
Courtesy of Proc. IRE 
and Wireless Engineer 


UTILIZATION OF ANALOG 
EQUIPMENT 


681.142 57-98 
Applications of a Transformer Analogue 
Computer—J. R. Barker. (Brit. J. Appl. 
Phys., vol. 7, pp. 303-307; August, 1956.) 
Use of the Blackburn analyzer for extracting 
latent roots of matrices, locating zeros of 
polynomials, and solving linear and non- 
linear simultaneous equations is discussed. 
Courtesy of Proc. IRE 
and Wireless Engineer 


57-99 

Ideal Transformers in the Synthesis of 
Analog Computer Circuits—R. H. MacNeal 
and G. D. McCann. (Proc. 1955 Western 
Joint Computer Conf., pp. 16-23: 1955.) This 
article describes the use of transformers in 
electric analog computers to solve sets of 
algebraic equations having constant, real 
coefficients. The authors indicate that very 
nearly ideal transformers can be constructed 
and that, therefore, the techniques discussed 
in the article have practical significance. 
They show, using Cauer networks, that any 
coefficient matrix that can be transformed 
into a diagonal matrix with a triangular 
transformation matrix can be synthesized 
with the use of ideal transformers. This con- 
dition is much less restrictive than the con- 
ditions for realizability of a transformerless 
resistance-analog network and, therefore, 
more types of sets of equations can be solved. 
Also, with the use of transformers coordinate 
transformations can be performed. These 
cannot, in general, be performed with trans- 
formerless resistance networks. In many 
cases, physical measurements can be made 
on a mechanical system only if the system 
is restrained from rigid body movement. In 
these cases, electrical analogs must be syn- 
thesized using the information obtainable 
from the restrained physical system. This 
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can be done using a technique described in 
this paper. Finally, some brief examples of 
the application of these techniques are de- 
scribed. 

Peter G. Pantazelos 


57-100 
An Error Analysis of Electronic Analog 
Computers—V. A. Marsocci. (IRE TRANS., 
vol. EC-5, pp. 207-212; December, 1956.) 
Due to the physical unrealizability of elec- 
tronic adding and integrating circuits with 
ideal characteristics, errors will be intro- 
duced in the solution of differential equa- 
tions obtained by the use of electrical 
analog computers. Numerical errors in the 
solution will be introduced by fluctuations 
in the value of plate and of grid supply volt- 
ages, changes in the values of circuit com- 
ponents, and changes in the values of the 
vacuum tube constants. In addition, the 
limited frequency response of the machine 
components will cause the computer to solve 
a characteristic equation of a higher order 
than the original characteristic equation 
whose solution is desired. The error in the 
solution manifests itself as a shifting in the 
roots of the original characteristic equation 
as well as the production of some extra roots. 
The effect of this change in the root position 
as well as the presence of the extra roots is 
experienced in the curve of the solution as a 
function of the independent variable. In a 
paper on the accuracy of differential ana- 
lyzers, Macnee has derived an expression 
which gives the value of the characteristic 
root shift. The use of this expression is 
accurate only for certain types of ordinary 
differential equations. In this paper a new 
expression for the value of the root shift is 
derived. The analysis preceding the new 
root-shift expression is developed in such a 
manner as to include the Macnee analysis as 
a special case. 
Courtesy of Proc. IRE 


681.142 :512.831 57-101 
Analog Computer Synthesis and Error 
Matrices—P. M. Honnell and R. E. Horn. 
(Commun. and Electronics, pp. 26-32; March, 
1956.) The performance of analog networks 
is studied by means of matrix analysis; 
errors and stability are evaluated. 
Courtesy of Proc. IRE 
and Wireless Engineer 


581.142:512 57-102 
Solution of Algebraic Equations on an 
Analogue Computer—C. R. Cahn. (Rev. Scz. 
Instr., vol. 27, pp. 856-858; October, 1956.) 
The roots of the equation are found with an 
electronic differential analyzer, using a 
method in which the operator adjusts a 
gauged potentiometer while observing a 
transient on a voltmeter or oscilloscope. 
Factors affecting the accuracy are discussed. 
Courtesy of Proc. IRE 

and Wireless Engineer 


57-103 

The Solution of Algebraic, Transcen- 
dental and Integral Equations by Means of 
Analog Computers—I. M. Vitenberg and 
E. A. Gluzberg. (Avtomat. i Telemeh., vol. 17, 
pp. 590-000, appendix to no. 7, 2.; 1956. 
Russian. English summary.) The authors 
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propose to solve the equations by minimizing 
the sum of absolute values of residuals, and 
for the minimization suggest auxiliary de- 
vices for which circuit diagrams are given. 
A. S. Householder 

Courtesy of Mathematical Reviews 


57-104 
Representation of Nonlinear Functions 
by Means of Operational Amplifiers— 
Robert M. Howe. (IRE Trans., vol. EC-5, 
pp. 203-206; December, 1956.) The repre- 
sentation of a wide variety of nonlinear func- 
tions by means of the interconnection of un- 
stabilized operational amplifiers is discussed. 
The nonlinear functions described include 
rectification, saturation functions, coulomb 
friction, dead space, and starting friction. 
The use of operational amplifiers alone to 
produce square waves and triangular waves, 
as well as gating operations, is also dis- 
cussed. These latter circuits are combined to 
give a time division multiplier using only 
standard operational amplifiers as compo- 
nents. Accuracy capabilities for all of these 
nonlinear operations are the order of 0.01 to 
1 per cent. 
Courtesy of Proc. IRE 


57-105 
Representation of Functions of Several 
Variables by Means of Adders, Multipliers 
and Simple Functional Instruments—lI. S. 
Pinsker. (Trudy Inst. Masinoved. Sem. Toén. 
Masinostro. Priborostr., vol. 8, pp. 35-51; 
1955. Russian.) Functions of one or two 
independent variables can be simply and 
precisely mechanized. Process of addition 
and multiplication may also be simply 
mechanized. Author proposes a scheme for 
simple mechanization of a function of 
variables by approximating it with sums and 
products of functions which individually 
contain not more than two of the ” variables. 
Thus, f(x, y, ) may be represented by sums 
of terms of the following types: 


a(x) - Bly) +r); ale, £) Bly, t) 7x, 9); 
a(x) - Bly, £); 


a(x, y)- B(x, 4); etc. Only enough terms are 
selected to give the desired precision, and 
this is done by successive compensation to 
minimize the number of terms. A numerical 
example converts a set of tabulated values 
for f(x, y, t) to the form f(y, £) +-a2(x) - Bay, é) 
with 5-place precision. 
W. W. Soroka 
Courtesy of Mathematical Reviews 


DIGITAL COMPONENT 
RESEARCH 


57-106 

Junction Transistor Switching Circuits 
for High-Speed Digital Computer Applica- 
tions—G. J. Prom and R. L. Crosby. (IRE 
TRANS., vol. EC-5, pp. 192-196; December, 
1956.) This paper describes junction transis- 
tor switching circuits capable of reliable 
operation at a clock rate of one megacycle. 
These circuits, consisting of a flip-flop, a 
gated pulse amplifier, and diode gates, con- 
sume a minimum of power and operate over 
a temperature range of —55°C to +85°C 
with complete transistor interchangeability. 
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Applications of these circuits to binary 
counters, shift registers, and accumulators 
are also presented. 

Courtesy of Proc. IRE 


621.318.57 :621.314.7 57-107 
An Asymmetrical Bistable Circuit using 
Junction Transistors—(Mullard Tech. Com- 
mun., vol. 2, pp. 254-278; July, 1956.) Con- 
ditions for the stable states of the basic 
switching circuit are analyzed and an em- 
pirical method for investigating the dynamic 
operation is presented. Detailed procedure 
for the design of a particular modified circuit 
is indicated. Reliable switching times of the 
order of 4 usec may be obtained with repeti- 
tion rates up to a fifth of the grounded-base 
cutoff frequency; trigger sensitivity is good. 
Courtesy of Proc. IRE 

and Wireless Engineer 


621.375.4.018.7 :621.314.7:681.142 57-108 
Transistor Pulse Regenerative Ampli- 
fiers—F. H. Tendick, Jr. (Bell Sys. Tech. J., 
vol. 35, pp. 1085-1114; September, 1956.) 
Design techniques are presented for synchro- 
nized regenerative amplifiers operating at a 
pulse repetition rate of the order of 1 mc and 
suitable for use in digital computers. 
Courtesy of Proc. IRE 
and Wireless Engineer 


621.394: 621.376.56:621.375.4.018.7 :314.7 
57-109 
Transistorized Binary Pulse Regenerator 
—L. R. Wrathall. (Bell Sys. Tech. J., vol. 
35, pp. 1059-1084; September, 1956.) A 
simple repeater circuit is described which is 
suitable for use in a 12-channel pcm system 
over substantial lengths of transmission line. 
The system is arranged so that distortion due 
to LF cutoff in the output of one repeater is 
compensated in the next repeater, special 
feedback connections being provided for this 
purpose. Some performance figures and os- 
cillograms are presented. The effect of inter- 
ference on the production of errors is dis- 

cussed. 

Courtesy of Proc. IRE 
and Wireless Engineer 


57-110 

The Effect of Collector Capacity on the 
Transient Response of Junction Transistors 
—J. W. Easley. (IRE Trans., vol. ED-4, 
pp. 6-14; January, 1957.) The effect of col- 
lector depletion layer capacity on the tran- 
sient response of junction transistors to a 
current input is calculated for the case of a 
resistive load. Expressions are given for the 
small-signal rise time of the common base, 
emitter, and collector configurations, and 
for the large-signal turn-on and decay times 
of the common-emitter and collector con- 
figurations. The analysis shows that the 
transient durations under most conditions of 
operation are approximately (1+waRiC.) 
times those which would be predicted for 
the short-circuit output approximation re- 
ported by Moll. Experimental results are 
reported which exhibit an excellent agree- 
ment with the analysis over a wide range of 
woRtC,. An empirical examination has been 
made of the dependence of large-signal 
switching time on the range of operation 
point excursion. A satisfactory approximate 
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representation of this dependence is provided 
by a first-order correction factor, which takes 
into account the functional dependence of 
w®q and C, on collector voltage. 

Courtesy of Proc. IRE 


57-111 
High-Speed Gating Circuit Using the 
E80T Beam Deflection Tube—L. Sperling 
and R. W. Tackett. (IRE TRANs., vol. ED-4, 
pp. 59-63; January, 1957.) This paper de- 
scribes a high-speed gate circuit for an in- 
formation sampling system employing the 
E80T beam deflection tube. The time re- 
quired to open this gate fully is less than 
7 musec. This gate is superior to conventional 
multigrid gates in that the circuits are less 
complex, more reliable, and have only mini- 
mal signal feed-through. Furthermore, a 
preliminary stage of pulse stretching is 
available without additional circuit ele- 
ments. 
Courtesy of Proc. IRE 


57-112 
Pulse Generator and High-Speed Mem- 
ory Circuit—Z. Bay and N. T. Grisamore. 
(IRE Trans., vol. EC-5, pp. 213-218; De- 
cember, 1956.) Circuits for the recycling of 
pulses by means of a driving tube and an 
electromagnetic delay line have been de- 
veloped. The necessary characteristic for the 
driving tube is shown and the effects of the 
delay line on the amplitude and width of 
pulses with respect to recycling operation 
are explained. Two modes of operation of 
these circuits are possible. One mode of 
operation allows any number of pulses in a 
recycling period, the number being limited 
only by the time space on the delay line. The 
other mode restricts the number of pulses in 
a recycling period to a particular value. Ex- 
perimental circuits are shown which have 
been used as generators of pulses as short as 
5 mysec at frequencies as high as 50 mc. 
Other circuits are shown which can be used 
as memory circuits for the storage of a num- 
ber of these short pulses. 
Courtesy of Proc. IRE 


621.318.57 : 621.387 57-113 
The Design of Cold-Cathode-Valve Cir- 
cuits—J. E. Flood and J. B. Warman. (Elec- 
tronic Eng., vol. 28, pp. 416-421, 489-493, 
and 528-532; October-December, 1956.) 
Switching circuits using cold-cathode diodes 
and triodes are discussed. Circuit elements 
are described for performing logical opera- 
tions, counting, information storage, etc. 
The effects of tolerances on circuit operation 
are examined. Applications of multicathode 
tubes are mentioned. 37 references. 
Courtesy of Proc. IRE 
and Wireless Engineer 


681.142:538.221 57-114 

High-Speed Coincident-Flux Magnetic 
Storage Principles—L. P. Hunter and E. W. 
Bauer. (J. Appl. Phys., vol. 27, pp. 1257- 
1261; November, 1956.) Random-access 
magnetic-core storage systems are discussed 
in which the summation of coincident mag- 
netic fluxes effects switching, the magnitude 
of the currents inducing the flux not being 
critical. Flux densities much greater than 
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that corresponding to the coercive field may 
be used, giving very short switching times. 
Courtesy of Proc. IRE 

and Wireless Engineer 


538.221 :539.23 57-115 
Resonance and Reversal Phenomena in 
Ferromagnetic Films—R. L. Conger and 
F. C. Essig. (Phys. Rev., vol. 104, pp. 915- 
923; November 15, 1956.) Experimental re- 
sults demonstrate the proportionality be- 
tween magnetization reversal time and 
magnetic-resonance-absorption line width. 
Courtesy of Proc. IRE 
and Wireless Engineer 


537.226/.228.1 57-116 
Ferroelectric Materials—P. Popper. (J. 
Inst. Elect. Eng., vol. 2, pp. 450-457; Au- 
gust, 1956.) A short review describing the 
basic physical properties and indicating 
possible applications of ferroelectric materi- 
als, particularly BaTiOs3. 
Courtesy of Proc. IRE 
and Wireless Engineer 


57-117 
A New Type of Ferroelectric Shift Regis- 


| ter—J. R. Anderson. (IRE TRANs., vol. 


EC-5, pp. 184-191; December, 1956.) Ferro- 
electric shift registers having completely in- 


_ dependent parallel or serial inputs and out- 


puts have been designed and constructed. 
The principal components of these shift 
registers are single crystals of barium 
titanate and silicon junction diodes. Two 
ferroelectric units and two to three silicon 
junction diodes are required for each stage 
of the shift register. Practical operating 
speeds for 10-stage shift registers with tran- 
sistor drives are at present from 0 to 5 kc. 
The small size of the ferroelectric units and 
the low power consumption in this speed 


range make the ferroelectric shift register 


attractive for many digital circuit applica- 
tions. 
Courtesy of Proc. IRE 


537.226/.228.1:546.431.824-31 57-118 
The Effect of the Polarization Conditions 
on the Piezoelectric Properties of Barium 
Titanate—S. V. Bogdanov, B. M. Vul, and 
R. Ya. Razbash. (Zh. Tekh. Fiz., vol. 26, pp. 
958-962; May, 1956.) Polycrystalline 
BaTiO; elements must be polarized in a 
strong dc field. With specimens of appreci- 
able thickness (15-25 mm), fields of the 
order of 30-50 kv/cm have to be used, with 
the attendant inconvenience and _ possible 
damage to the specimen. Lower polarizing 
voltages can be used if the temperature at 
which polarization is carried out is raised; 
the dielectric strength is not affected (Vul, 
et al., Zh. Eksp. Teor. Fiz., vol. 20, pp. 465— 
470; May, 1950). This has been confirmed 
experimentally; but even at temperatures 
approaching the Curie point, the polarizing 
voltage should not be below 5 kv/cm. 
Courtesy of Proc. IRE 
and Wireless Engineer 


SpYIPHAL 57-119 

Ferroelectricity of Glycine Sulphate— 
Bones Vatthiass Gy Ee Miller eandelia ©. 
Remeika. (Phys. Rev., vol. 104, pp. 849-850; 
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November 1, 1956.) Glycine sulphate and 
its isomorphous selenate are ferroelectric 
with Curie points 47°C and 22°C, respec- 
tively. For glycine sulphate at room tem- 
perature the spontaneous polarization is 
2.210 coul/cm? and the coercive field is 
220 v/cm. A formal similarity among ferro- 
electric sulphates regardless of crystal struc- 
ture is suggested. 
Courtesy of Proc. IRE 
and Wireless Engineer 


537.266/.227 57-120 
Thiourea, a New Ferroelectric—A. L. 
Solomon. (Phys. Rev., vol. 104, p. 1191; No- 
vember 15, 1956.) Crystals are orthorhombic 
at room temperature. With electrodes on 
(010) faces, a pronounced dielectric anomaly 
is found at —104.8°C. The coercive field is 
less than 1000 v/cm at 60 cps and —110°C. 
Courtesy of Proc. IRE 

and Wireless Engineer 


535.376 57-121 
Electroluminescence—D. W. G. Ballen- 
tyne. (Wireless World, vol. 63, pp. 128-132; 
March, 1957.) Sustained emission of light 
can be obtained from an unexcited phosphor 
by suspending it in the dielectric of a ca- 
pacitor to which an alternating field is ap- 
plied. Recent progress is described and pos- 
sible applications to illumination, television, 
and storage of binary-code numerical data 
are discussed briefly. For full paper, see 
Marconi Rev., vol. 19, pp. 160-175; 4th 
Quarter, 1956. 
Courtesy of Proc. IRE 
and Wireless Engineer 


57-122 

Quarterly Report No. 1, Third Series— 
jRe Bowman, © oH. Ds Walkins; sets! 
(Quart. Rep. Computer Components Fellow- 
ship Mellon Inst., vii-4 pp.; October 1, 
1956 to December 31, 1956.) The initial 
section contains some notes relative to the 
present experimental program and objectives 
of the Computer Components Fellowship, 
sponsored by the Air Force Cambridge Re- 
search Center under Contract No. AF 
19(604)-1959. The concept of “modular 
printed circuitry” which appears to offer 
great promise for future development, has 
been singled out for concentrated study and 
evaluation. The preparation and testing of 
these circuits using several techniques de- 
veloped by the Fellowship are described. 
Resistors and capacitors have been printed 
successfully using the screen process; results 
of tests at temperatures from room tem- 
perature to 260° C are presented. Analysis 
of a vacuum-deposited gold-palladium re- 
sistor film closely approximated that of the 
bulk material; a comparison of test values 
for resistors and capacitors deposited on 
alumina and on glass substrates is made. 
Some of the problems encountered with 
filaments and crucibles during vacuum 
evaporation are discussed; the use of boron 
nitride as a high-temperature crucible ma- 
terial appears promising. Refractory masks, 
formed by a casting process and by ma- 
chining, were found to yield excellent reso- 
lution in the spray-painting of stannic 
oxide resistors; the spraying of conductive 
and dielectric enamels is proposed. Proce- 
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dures used in the testing of components at 
elevated temperatures are described. 
C. H. T. Wilkins 


DIGITAL SYSTEM RESEARCH 


57-123 
Micro-Programming—R. J. Mercer. (J. 
Assoc. Comp. Mach., vol. 4, pp. 157-171; 
April, 1957.) Breathes there a sophisticated 
programmer with soul so dead who never to 
himself has said: “If only I could make one 
little change in the order code of this ma- 
chine.” The basic concept of micro-pro- 
gramming is that every programmer should 
be allowed to function as his own logical 
designer. For, as Mr. Mercer writes: “The 
machine that provides the ideal order code 
for every problem will be the true ‘gen- 
eral purpose’ machine.” Since all digital 
compu ‘er operations are combinative func- 
tions of a limited number of basic “micro- 
operations” or “sub-commands,” it is the 
author’s thesis that programmers should be 
allowed to work directly with these ele- 
mentary operations. In support of this, he 
piovides an analysis of the relative machine 
times involved in solving a cyclic permuta- 
tion problem on the general purpose com- 
puter SWAC and on a hypothetical com 
puter that allows for micro-programming. 
The micro-program computer solves the 
problem in about one-third of the time re- 
quired on SWAC. A total of 46 program 
instructions are required for the micro- 
program machine as opposed to 55 of 
SWAC’s four-address instructions. Perhaps 
a more complete measure of comparison 
might have been available if Mr. Mercer had 
also included a statement of the respective 
programming times. It is, of course, in the 
area of actual program construction that the 
concept of micro-programming breaks down 
as a practicable technique. This is a fact 
which some of our more senior programmers 
tend to overlook in their understandable 
enthusiasm for newer and more challenging 
methods. Since each “general purpose” order 
may perhaps exist as a combination of some 
twenty micro-operations, each of which 
must be performed in a rigid time sequence, 
the inherent difficulty of constructing and 
debugging a micro-program would seem to 
far outweigh the advantages obtained 
through somewhat more effective machine 
operation. 
Herbert T. Glantz 


57-124 
A Method for the Evaluation of a System 
of Boolean Algebraic Equations—J. A. 
Postley. (MTA C, vol. 9, pp. 5-8; 1955.) The 
author describes a way of using punched 
cards to assist in making certain calculations 
involving a fairly large number of variables 
which are always either 0 or 1. The basic 
principle is that if one indicates the fulfil- 
ment of a condition in a given instance by 
punching a hole in a definite position in a 
card for that instance, then the simultane- 
ous fulfillment of the condition in all the 
instances can be tested by sighting through 
the batch of cards. This idea is applied to 
calculating the y, from the x, when we have 
equations of the form 


Wr = b (ar, fr Xi, iy 22 ins £r(X1, Seer ot })) 
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where ¢, f;, g- are Boolean functions in 
alternative (disjunctive) normal form. 

H. B. Curry 

Courtesy of Mathematical Reviews 


57-125 
Digital Computational Methods in Sym- 
bolic Logic, with Examples in Biochemistry 
—Robert S. Ledley. (Proc. Nat. Acad. Sci. 
U.S.A., vol. 41, pp. 498-511, errata, 796; 
1955.) In two previous papers [ Nat. Bur. 
Standards Rep. 3363; 1954. J. Operations 
Res. Soc. Amer., vol. 2, pp. 249-274; 1954 
(see 57-21, March, 1957)], the author pro- 
posed a technique useful for the mechanical 
solution of problems in Boolean algebra. The 
principle of this technique is that an ele- 
ment in a free Boolean algebra with m gen- 
erators can be represented as a_ binary 
number with 2” digits, these digits being the 
coefficients in a “development” (in the sense 
of Schréder) in which the atoms are ar- 
ranged in some standard order. The present 
paper contains some improvements in his 
methods. The procedures for solving Boolean 
equations are presented in terms of Boolean 
matrices, and consideration is given to cases 
where the generators are subject to condi- 
tions (“constraints”). At the end the author 
discusses two interesting and nontrivial 
examples from biochemistry. It now seems 
clear that the author’s methods save some 
labor in the manipulation of complex equa- 
tions; but his treatment is marred by a 
propensity to make simple things appear 
difficult, and by peculiarities of notation 
(such as numbering his digits from right to 
left and his rows from the bottom upwards) 
which conceal the relationship of his meth- 
ods to those which are more familiar. 
H. B. Curry 
Courtesy of Mathematical Reviews 


57-126 
Symbolic Methods in the Design of 
Delay- and Cycle-Free Logical Nets— 
George W. Patterson. (1954 IRE Con- 
VENTION RECORD, Part IV, pp. 58-64.) The 
author describes the relationship between 
the logical design of machines and the propo- 
sitional calculus via truth tables. The use of 
the calculus in the analysis, synthesis, and 
optimization of logical nets is described in 
several examples. 
S. Gorn 
Courtesy of Mathematical Reviews 


57-127 

A Note on Universal Turing Machines— 

M. D. Davis. (“Automata Studies,” in 
“Annals of Mathematics Studies,” no. 34, 
pp. 167-175, Princeton University Press, 
Princeton, N.J.; 1956.) The author defines a 
universal Turing machine as one for which 
the set of Gédel numbers of the instantane- 
ous descriptions is complete. By instantane- 
ous descriptions he means initial tapes and 
states leading to a terminating machine 
reaction, and by complete he means a re- 
cursively enumerable set of integers into 
which every recursively enumerable set may 
be mapped by a suitable recursive function. 
This definition of a universal machine is 
justified by showing that 1) any computation 
may be encoded for such a machine, 2) any 
machine which may be encoded to produce 
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any recursively enumerable set is such a 
machine, and 3) the encoding in 1) may be 
achieved by a machine whose set of Gédel 
numbers for the instantaneous descriptions 
is not merely not complete but is actually 
recursively enumerable. 
S. Gorn 
Courtesy of Mathematical Reviews 


57-128 
A Universal Turing Machine with Two 
Internal States—Claude E. Shannon. 
(“Automata Studies,” in “Annals of Mathe- 
matics Studies,” no. 34, pp. 157-165, Prince- 
ton University Press, Princeton, N.J.; 1956.) 
The author shows that any Turing machine 
with an alphabet of m letters and x states is 
“essentially equivalent” to a machine with 
4mn+m symbols and two states. Thus a 
universal Turing machine may be con- 
structed with only two states. It is also 
shown that a single state machine cannot 
compute the successive digits of an irra- 
tional number. Thus a universal machine 
must have more than one state. Finally it is 
shown that any machine with m states and 
an alphabet of m letters is equivalent to a 
machine with an alphabet of two letters and 
(2'—1)n states, where J=1-+[logem]. 
S. Gorn 
Courtesy of Mathematical Reviews 


57-129 
The Inverstion of Functions Defined by 
Turing Machines—John McCarthy. (“Auto- 
mata Studies,” in “Annals of Mathematics 
Studies,” no. 34, pp. 177-181, Princeton 
University Press, Princeton, N.J.; 1956.) 
This is an informal discussion of the problem 
of designing a machine to solve “well-de- 
fined” intellectual problems. The author 
identifies this problem with that of inverting 
a partial recursive function f,(7) to yield a 
function g(m, r) such that fin(g(m, r)) =r. 
S. Gorn 
Courtesy of Mathematical Reviews 


57-130 

Computability by Probabilistic Machines 
—K. de Leeuw, E. F. Moore, C. E. Shannon, 
and N. Shapiro. (“Automata Studies,” in 
“Annals of Mathematics Studies,” no. 34, 
pp. 183-212, Princeton University Press, 
Princeton, N.J.; 1956.) The authors consider 
machines fulfilling the following conditions. 
1) For every input composed of a finite 
binary sequence there is an output com- 
posed of a finite sequence of symbols chosen 
from a set S. 2) The functional relationship 
between the input and output sequences is 
computable. 3) The output corresponding to 
an initial segment of any given input will be 
an initial segment of the output correspond- 
ing to that given input. For such machines, 
then, there is a computable function f(A) 
whose range is a subset of the set of infinite 
sequences chosen from S, and whose domain 
is the set of infinite binary sequences A. Any 
such machine together with a fixed input se- 
quence A is called an A machine. The set of 
output symbols, S, of an A machine is called 
A enumerable. The recursively enumerable 
sets are those which are A enumerable for A 
the sequence containing 1 exclusively; the 
authors also call them 1 enumerable, and the 
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enumerating machine a 1 machine. If the 
input tape is produced by a random device 
which yields the bits independently and 
with probability p of yielding a 1, the com- 
bination of the random device and the 
machine is called a p machine. SS is called 
strongly p enumerable if there is a machine 
producing S in any order with nonzero 
probability. If S,, is the set of output sym- 
bols printed by a p machine with a prob- 
ability greater than 4, then S, is called p 
enumerable. Let A, be the binary expansion 
of p, where 0<p<1. Then the authors show 
that the concepts “p enumerable,” “strongly 
p enumerable,” and “A, enumerable,” are 
effectively equivalent. Furthermore, if p is 
computable, any p enumerable or strongly 
p enumerable set is 1 enumerable, whereas 
if p is not computable there are p enumer- 
able and strongly p enumerable sets which 
are not 1 enumerable. Because of condition 3 
above, these concepts and results extend 
readily to the case where S is a fixed sequence 
of symbols. By a “stochastic machine” the 
authors mean one with an initial state Xo, a 
countable sequence of states, X1, Xo,--+: a 
countable set of output symbols si, s2+- +, 
and a (not necessarily computable) transi- 
tion probability function, 
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giving the probability that the machine, 
having gone through states X;, to X;,, will 
print s,and go to state Xp. If P is computa- 
ble, the machine is called a computable 
stochastic or c-s machine. To any p machine 
M one may associate an “equivalent” sto- 
chastic machine. It is a c-s machine if and 
only if p is computable. The authors show, 
finally, that every c-s machine is effectively 
equivalent to a 4 machine, and every c-s- 
enumerable set is effectively 1 enumerable. 
S. Gorn 

Courtesy of Mathematical Reviews 


57-131 
Algorithmes de Markov et Théorie des 
Machines—Jacques Riguet. (C. R. Acad. 
Sci. Paris, vol. 242, pp. 435-437; 1956.) 
The concept of “normal algorithm” in the 
sense of A. A. Markov (Trudy Mat. Inst. 
Steklov, 42; 1954. MR 17, 1038) is related to 
the author’s general theory (C. R. Acad. 
Sct. Paris, 237, pp. 425-427; 1953. MR 15, 
559) of Ashby machines by an abstract 
“flow diagram.” 
G. BIRKHOFF 
Courtesy of Mathematical Reviews 
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57-132 
Punched-Card Transcriber for Auto- 
matic Computers—Anonymous. ( Nat. Bur. 
Standards Tech. News Bull., vol. 41, pp. 38- 
39; March, 1957.) Punched cards are fed 
endwise at up to 600 cards per minute, and 
the columns are converted sequentially into 
4- or 6-digit binary codes and recorded upon 
magnetic wire that can be used for input to 
SEAC. 
R. D. Elbourn 


57-133 

FOSDIC II Reads Microfilmed Punched 
Cards—Anonymous. (Nat. Bur. Standards 
Tech. News Bull., vol. 40, pp. 72-74; May, 
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1957.) Up to 13,000 punched cards are re- 
corded upon a 100-foot roll of 16-mm micro- 
film, The film is searched at over 4000 cards 
per minute by electronic flying-spot scan- 
ning of any selected 10 card columns. When- 
ever those match a plugboard specification, 
a complete duplicate card is punched, up to 
a punching rate of 100 cards per minute. 
R. D. Elbourn 


57-134 
A Tank Farm Data Reduction System— 
D. J. Gimpel. (RE Trans., vol. IE-4, pp. 
94-100; March, 1957.) A tank farm data re- 
duction system has been developed for the 
new Tidewater Oil Company installation in 
Delaware by the Armour Research Founda- 
tion and Panellit, Inc. The function of the 
unit is to secure the temperature corrected 
volume of fluid in each of the approximately 
100 tanks in the field. The inputs to the sys- 
tem are the fluid height and average tank 
temperature. Fluid volume is tabulated dig- 
itally as a function of the height on magnetic 
tape. The system automatically searches the 
tape for the indicated volume and multiplies 
the number by the temperature correction 
factor. This paper describes the operation of 
the multiplier, the tape search elements, and 
the sensing instruments employed in the 
field. The factors governing the selection of 
the specific elements in the storage and 
computing system are also discussed. 
Courtesy of Proc. IRE 


57-135 
The IBM 705 EDPM Memory System 
—R. E. Merwin. (IRE TRAns., vol. EC-5, 
pp. 219-223; December, 1956.) The IBM 
705 memory system utilizes magnetic cores 
both as a storage element and also in a 
matrix address selection system. The mag- 
netic core has been established as a mem- 
ory element for large data processing ma- 
chines. The core compares very favorably 
with other means of storage with respect to 
such factors as speed, reliability, size, cost, 
life, and simplicity of associated electronic 
circuitry. The memory consists of a main 
20,000 character unit and a 512 character 
storage unit. Both are three-dimensional 
coincident current systems with the larger 
containing 35 planes of 4000 cores each and 
the other consisting of seven planes of 512 
cores each. The basic memory cycle is 9 
usec long when operating with the input- 
output units or on internal transfer of data. 
When operating with the central processing 
unit a 17-ysec cycle is required. Data may 
be transferred within memory in five char- 
acter blocks, and the five character instruc- 
tions are transmitted to the control unit in 
one-memory cycle. Transfers between mem- 
ory and the input-output and arithmetic 
units is serial by character. Use of the mag- 
netic core matrix switch greatly reduces 
the electronic equipment required to drive 
the memory. Simplified circuitry requiring 
no adjustments eliminates any maintenance 
time required for making routine adjust- 
ments. Indefinite life of the core eliminates 
any replacement problem of the basic stor- 
age element itself. 
Courtesy of Proc. IRE 
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57-136 
Reliability of an Air Defense Computing 
System: Component Development—H. F. 
Heath, Jr. (IRE Trans., vol. EC-5, pp. 
224-226; December, 1956.) This paper pre- 
sents the general aspects of the component 
development program for the AN/FSQ-7 
Air Defense Computer. The requirements 
of the system for high reliability and long 
life necessitate proper selection of the type 
of component, proper specification of the 
component to the manufacturer, and proper 
component application by the circuit design 
engineer. The component development pro- 
gram has made free use of ideas from the 
computer industry and the component in- 
dustry. 
Courtesy of Proc. IRE 


57-137 
Reliability of an Air Defense Computing 
System: Circuit Design—R. E. Nienburg. 
(IRE Trans., vol. EC-5, pp. 227-233; De- 
cember, 1956.) Extreme reliability resulting 
in no unscheduled down-time and a low 
ratio of scheduled maintenance to operate 
time was the objective of the AN/FSQ-7 de- 
sign program. The circuit design philosophy 
of this program is presented. In addition, an 
approach is given whereby the concept of 
marginal checking is applied to determine 
quantitatively 1) the relative reliability of 
computer circuits and 2) that a margin of 
safety consistent with the circuit design 
philosophy existed. An appendix is included 
setting forth actual examples in a qualitative 
manner. 
Courtesy of Proc. IRE 


57-138 
Reliability of an Air Defense Computing 
System: Marginal Checking and Main- 
tenance Programming—M. M. Astrahan 
and L. R. Walters. (IRE TRANs., vol. EC-5, 
pp. 233-237; December, 1956.) Marginal 
checking by varying supply voltages for 
some time has been a means of preventive 
maintenance for electronic systems. Some 
important innovations have been employed 
in the marginal checking system of the 
AN/FSQ-7 air defense computer to give a 
more effective high-speed preventive main- 
tenance technique. Completely automatic 
preventive maintenance testing is discussed 
incorporating program control of the margi- 
nal checking system. 
Courtesy of Proc. IRE 


UTILIZATION OF DIGITAL 
EQUIPMENT 


681.142 57-139 
Definitions of Terms for Program-Con- 
trolled Electronic Computers—( Nachrichten- 
tech. Z., vol. 9, pp. 434-436; September, 
1956.) About 40 proposed terms are listed 
with their definition and English equivalent. 
Courtesy of Proc. IRE 

and Wireless Engineer 


57-140 

Pitfalls in Computation—I. A. Stegun 
and M. Abramowitz. (J. Soc. Industrial and 
Appl. Math., vol. 4, pp. 207-219; December, 
1956.) As the title implies, there are trouble- 
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some situations arising in computation (with 
digital machines of any kind) which should 
be avoided where possible. Under the sub- 
titles, Elementary Pitfalls, Functional Rela- 
tions, Indeterminate Forms, Series Calcula- 
tions, Numerical Differentiation, and Nu- 
merical Quadrature, the authors indicate 
with examples how some of the singular situ- 
ations, overflows, loss of significant figures, 
etc., can be obviated. It is noted that float- 
ing point operation is no panacea. 

T. H. Southard 


57-141 
Principles of Programming—J. B. Ward. 
(Electrical Eng., vol. 75, pp. 1078-1083; 
December, 1956.) This is an introduction to 
programming stored program computers. A 
hypothetical computer is described by giving 
the list of instructions it obeys, and the 
general organization and operation of the 
computer is stated. Two elementary com- 
putational problems are coded and flow dia- 
grammed, as a means of describing the 
reduction of mathematical problems to a 
sequence of instructions. Elementary prin- 
ciples of programming are brought out in the 
development of these programs. 
Harry T. Larson 


57-142 
Mathematical Machines.—(Stroje na 
Zpracovini Informaci, vol. 1, pp. 7-132; 


1953. Czech., Russian and English sum- 
maries.) “The first part contains results of 
the research in numerical calculation meth- 
ods suitable for solution of problems on the 
Czechoslovak automatic computer SAPO. 
Coding and a symbolism suitable to formu- 
late instructions for the machine are ex- 
plained. In this part a method is described 
how to form detailed instructions (the pro- 
gramming) for the machine in accordance 
with a given problem. The use of the method 
is illustrated by several examples. The sec- 
ond part deals with the use of Czechoslovak 
punched card machines for numerical solu- 
tions of mathematical problems.” (From the 
English summary.) Chapter headings: 1) 
Introduction to Automatic Computation, 
2) Coding Automatic Computation, 3) Pre- 
paring Instruction Nets, 4) Investigation of 
a Centered Optical System by Automatic 
Computation, 5) Solution of an Ordinary 
Differential Equation of Second Order by 
Automatic Computation, 6) Processing of 
Punched Cards, 7) Application of a Punched- 
Card Machine to the Solution of an Engi- 
neering Probiem. 

Courtesy of Mathematical Reviews 


57-143 

A Centralized Data Processing System— 
Jerome J. Dover. (1954 Proc. Western Com- 
puter Conference, pp. 172-183.) The author 
discusses the problems encountered in pre- 
paring large volumes of flight test data for 
processing by IBM Card Programmed Cal- 
culators, and the solutions arrived at in 1954 
by the Air Force Flight Test Center at Ed- 
wards AFB. The reduction in calculating 
time provided even by CPC’s gave rise to a 
serious bottleneck in the stage of reading 
data (from films, oscillographs, etc.), digitali- 
zation of this data, and application of cor- 
rections for instrument, calibration, and 


ly 


IRE TRANSACTIONS ON ELECTRONIC COMPUTERS 


This page has been left blank in order 
that readers may mount all reviews on cards. 
—The Editor 


September 


1957 


other errors. A lengthy study of the problem 
was made by R. M. Parsons and Co., and 
the resulting proposal for a centralized data- 
processing system is described in some de- 
tail in this paper. Significant in the system 
is the introduction of the so-called “human 
filter,” z.e., the inspection by the test engi- 
neer of initially recorded information in un- 
corrected analog form with a view to elimi- 
nating large masses of information not 
requiring further processing. The influence 
of these decisions upon the validity of the 
final results requires no comment. How- 
ever, this filtering was considered essen- 
tial in order to avoid, to quote, “astronom- 
ical numbers of data points involving 
stacks of IBM cards literally miles high.” 
H. B. Prendergast 


57-144 
Problems in Acceptance Testing of Digi- 
tal Computers—Paul Brock and Sybil Rock. 
(J. Assoc. Comp. Mach., vol. 1, pp. 82-87; 
April, 1954.) To protect both the seller and 
the buyer a reasonable and efficient accept- 
ance testing procedure is mandatory. The 
authors are especially concerned with pro- 
grammed checks and the criteria for deter- 
mining passage or failure of such tests. A 
statistical approach to this problem em- 
ploying methods of sequential analysis is 
outlined. Perhaps the most enlightening 
section of this paper is the actual description 
of various tests in use during 1954. 
W. P. Keating 


57-145 

The Use of Electronic Data Processing 
Systems in the Life Insurance Business.— 
M. E. Davis. (1953, Proc. Eastern Joint 
Computer Conference, pp. 11-17.) This arti- 
cle presented, in general terms, the status 
and philosophy of electronic data processing 
in life insurance, as of the end of 1953, start- 
ing with the work of the Committee of the 
Society of Actuaries appointed to study this 
area. To provide a basis for system com- 
parisons the committee developed the Con- 
solidated Functions Plan for administering 
life insurance policies in a manner suitable 
to any of several different electronic data- 
processing systems. This plan suggests a 
large reduction in the number of card files 
being kept and a combination of much 
work often done separately in different de- 
partments. The author discusses major ac- 
tivity categories generated by policy trans- 
actions, presents a case for maintaining, at 
least for the present, card files as primary 
records rather than tapes, discusses some 
limitations of current systems, the elements 
involved in acquiring a system, and some 
future implications. Some of the author’s 
points follow: 1) Major benefits would come 
from adapting the Consolidated Function 
Plan with punched card electronic calculator 
methods. 2) Additional benefits would be 
associated with magnetic tape processing 
from primary card files. 3) Additional bene- 
fits associated with use of primary tape files 
are not large. 4) Large random access mem- 
mory is not of crucial importance. 5) Ap- 
proximately 90 per cent of total potential 
possible with highly automatic future de- 
vices could be realized with then existing 
equipment. 6) Magnetic tape systems can 
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be gainfully introduced in particular areas 
without risking the entire recordkeeping 
system of the company. 7) Actual use of 
current models on day-to-day work is es- 
sential to the development of proper appli- 
cations and of improved future processing 
systems. The author seems to believe that 
by far the major portion of the ultimate 
potential can be achieved with existing sys- 
tems, and that radical changes should be 
introduced gradually, while obtaining ex- 
perience with advanced equipment in par- 
ticular areas which can be justified economi- 
cally on their own merits without jeopardiz- 
ing the entire company operation. This ap- 
proach has by now become familiar in a 
number of areas other than insurance. It 
would be of interest to compare this report 
with a more recent survey in the same or in 
other areas. Unfortunately this reviewer is 
not familiar with a comparable and more 
recent survey. He suspects that most of the 
author’s philosophy will stand up today, in 
the light of the experience added in the past 
few years. 

George W. Brown 


57-146 
Digital Computers Can Aid Utilities— 
F. J. Maginniss. (Electrical Eng., vol. 76, 
pp. 124-125; February, 1957.) This is a 
brief statement of the various ways digital 
computers are useful in the electrical power 
distribution utilities. Computers can be used 
to speed up calculations presently performed 
by other methods; examples are load fore- 
casting and heat balance calculations. Com- 
puters are making it possible to solve prob- 
lems by better methods; examples are solu- 
tion of short-circuit studies, determination 
of loss formula coefficients, and solution of 
network transient problems. Finally, the 
speed and economics of computer operation 
make it practical to solve new problems; 
examples are the determination of critical 
shaft speeds in multiunit turbine generators 
and complete analysis of a steam piping 
system. 
Harry T. Larson 


57-147 

Computers—The Key to Modern Manu- 
facturing Scheduling—J. J. Gravel and 
T. F. Kavanagh. (IRE Trans., vol. IE-4, 
pp. 90-93; March, 1957.) Manufacturing 
operations with poor scheduling plans are 
headed for trouble. Load capacity analysis is 
a technique for measuring the feasibility 
and desirability of proposed scheduling 
plans. Simply stated mathematically, load 
capacity analysis consists of a series of multi- 
plications and additions. However, the 
numerous computations in a typical prob- 
lem usually take more time than can be 
allowed. The paper describes a special pur- 
pose analog computer specifically designed 
to solve this problem in a matter of minutes. 
Courtesy of Proc. IRE 


57-148 

A Plan for Programming Analysis of 
Variance for General Purpose Computers— 
H. O. Hartley. (Biometrics, vol. 12, pp. 
110-122; 1956.) The organization of compu- 
tations for analyzing a k-factor experiment 
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is described in detail for k =3, and it is shown 
how the analysis of other designs can be 
reduced to the factorial. As the author ad- 
mits, in some cases the reduction might be 
more complicated than the calculations pro- 
grammed, which are basically only sums and 
sums of squares. 
A. S. Householder 
Courtesy of Mathematical Reviews 


57-149 

A Manual for Coding Organic Com- 
pounds for Use with a Mechanized Search- 
ing System—T. R. Norton and A. Opler. 
(The Dow Chemical Co., Pittsburg, Calif., 
56 pp.; 1953. Revised 1956.) A Manual for 
Programming Computers for Use with a 
Mechanized System for Searching Organic 
Compounds—A. Opler and T. R. Norton. 
(The Dow Chemical Co., Pittsburg, Calif., 
23 pp.; 1956; and New Speed to Structural 
Searches, Chem and Eng. News, vol. 34, 
pp. 2812-2816; 1956.) One of the many 
applications of modern computers which par- 
ticularly interests the chemist 1s the mecha- 
nization of searching the ponderous accumu- 
lation of literature in his field. It will be some 
time before the ultimate electronic library is 
achieved, but significant steps are being 
made and the work of Opler and Norton is 
one of them. They have devised a technique 
“For Coding Organic Compounds” and put 
it to practice with two recent computers, 
the Datatron and the IBM 701. Their pur- 
pose was to search rapidly the thousands 
of known organic chemical compounds for 
correlating physical, chemical, or biological 
properties with structure. The results of 
their efforts to date are summarized in an 
article in Chemical and Engineering News 
and the techniques are elaborated in the two 
manuals available from The Dow Chemical 
Company. The article, “New Speed to 
Structural Searches,” provides a good intro- 
duction to and review of the problems and 
how they are being solved. The heart of the 
rapid searching technique is the coding sys- 
tem employed to translate the organic struc- 
ture into numerical form. While a number of 
systems have been devised, the system of 
Opler and Norton represents a relatively 
complete reduction of organic structure no- 
tation to numerical form. This, in effect, 
makes the coding of searching and related 
routines a straightforward task for most 
computers. The coding system detailed in 
the first manual is built on a sequence of 
seven-digit numbers. There will be as many 
of these numbers in a sequence as there are 
chemical groups in the compound being 
coded. The system is designed to handle 
most types of organic compounds now known 
and is sufficiently flexible to accommodate 
some of the special classes of compounds cur- 
rently omitted. The coding manual is clear, 
concise, and adequately stocked with exam- 
ples. However, in the words of the authors, 
“The ultimate value of this convention (of 
coding) can only be shown by operating 
experience.” The manual for programming 
the computer gives a general outline of the 
type of program which the authors prepared 
to process the coded compounds and _ to 
search the file. Due to the various modes of 
programming now employed in current com- 
puters the manual was written very gener- 
ally. It is difficult to decide how general 
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or specific to make such a manual. From the 
point of view of those chemists who have 
done some coding, the compound notation 
system would become more acceptable if a 
few extra pages of detailed example were 
appended to the coding manual. Aside from 
that small point the manual very well out- 
lines the structure of the programs. Opler 
and Norton are to be commended for their 
fine work in this and other applications of 
computers to chemical problems and The 
Dow Chemical Company should also be 
commended for making this information 
generally available. 
F. H. Kruse 
Courtesy of Mathematical Tables 
and Other Aids to Computation 


57-150 
Number Theory on the SWAC—Emma 
Lehmer. (“Numerical Analysis” in “Pro- 
ceedings of Symposia on Applied Mathe- 
matics,” McGraw-Hill Book Co., Inc., New 
York, vol. VI, pp. 103-108; 1956. Published 
for Amer. Math. Soc., Providence, R. I.) 
The author’s account includes three classes 
of problems tried on the SWAC: 1) special 
computations (as the testing of Fermat 
primes, Mersenne primes, or difference sets) ; 
2) testing of hypotheses (such as Riemann’s, 
Polya’s, Turan’s, Fermat’s) unfortunately 
with no counter-examples occurring; 3) re- 
search problems (computational explorations 
into Jaccbsthal’s sums or Ramanujan’s 
function) often leading to theorems of 
Lehmer. 
Harvey Cohn 
Courtesy of Mathematical Reviews 


57-151 

Experiments in Chess—J. Kister, P. 
Stein, S. Ulam, W. Walden, and M. Wells. 
(J. Assoc. Comp. Mach., vol. 4, pp. 174-177; 
April, 1957.) This concise, interesting, and 
well written article contains a brief descrip- 
tion of the authors’ experiments in teaching 
the MANIAC computer to play chess. “The 
game which was played on the machine is 
not really chess but rather, so to speak, a 
miniature of it; we play on a 6X6 board, 
omitting the bishops, and with six pawns 
on each side.” The program was constructed 
so that the machine looked two moves 
ahead; two by white and two by black. In 
analyzing its future position at the end of 
each such possible chain of four moves the 
machine considered not only material ad- 
vantage; that is, actual pieces, but also 
positional advantage and mobility. The 
machine’s normal “thinking” time per move 
was about 12 minutes, although at a crucial 
point in one game it pondered for a full half- 
hour. Three experimental “matches” are 
described. Initially, MANIAC was matched 
against itself with inconclusive results. In a 
later match against a “strong” player, from 
whom it received a considerable handicap, 
MANIAC was in a very favorable position 
until “the machine chose a weak continua- 
tion which enabled its opponent to lay a 
3-move mating trap.” In a final game 
MANIAC proved to be superior to a labora- 
tory member who was quite a novice at the 
game. In summary, the authors feel that the 
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play of the machine “could be compared to 
that of one who has average aptitude for the 
game and experience amounting to 20 or 
30 full games played.” The authors very 
correctly point out that, while such experi- 
ments are diverting and interesting, the 
main value of these developmets is in pro- 
viding insight into the actual thought proc- 
esses of the human brain. In particular, it is 
felt that these experiments may lead to some 
new understanding of the brain’s technique 
for assimilating, organizing, and evaluating 
information. 

Herbert T. Glantz 
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Arithmetic Operations in Digital Com- 
puters—R. K. Richards. (D. Van Nostrand 
Co., Inc., New York, N. Y., iv+397 pp.; 
1955.) So far as this reviewer is aware, this 
important book contains the most complete 
existing description of the application of 
Boolean algebra to the logical design of digi- 
tal computers. It is already a standard hand- 
book of computer design used with profit by 
design engineers, students of the logic of 
computers, and students of the logic of such 
operations as microcoding. The author pre- 
pared the contents as a set of notes to be 
used in connection with a course offered to 
engineers in the laboratories of the Inter- 
national Business Machines Corporation. 
As such it is strictly utilitarian. Its bibliog- 
raphy is incomplete. In the index one does 
not find the name of von Neumann, and the 
name of Claude Shannon occurs just once; 
the Shannon reference credits him with 
appearing to have pointed out the adaptabil- 
ity of Boolean algebra to the design of 
switching circuits. Similarly, the index lists 
thirteen references to IBM, but none to any 
of the groups which have formed Sperry- 
Rand. The reviewer finds no quarrel with 
this detachment and biased reference. How- 
ever, the lack of complete references pre- 
cludes use of the book as a reliable basis for 
estimating the complete state of the science 
at the time the book was written. The author 
had a goal which he met well. He wanted to 
describe design of computing instruments 
and he turned to the material at hand. 
Where it was convenient and where it 
served his purpose he took material from 
other sources, and to the extent that he had 
information readily available concerning the 
ultimate source he seemed to give it. Thus 
he gives no fewer than a dozen examples of 
binary adders in block diagram form (using 
Boolean elements) and discusses their rela- 
tive merits. He goes into considerable detail 
concerning the difficulties of designing deci- 
mal components and again he illustrates his 
arguments with many block diagrams. In 
similar fashion he examines the other every- 
day problems of the designer of circuits for 
computers. He claims no new results and 
hence he feels little need for discussing rela- 
tions between his results and those of other 
workers. There is no discussion of the practi- 
cal limitations of circuit design. Thus the 
deterioration of pulses on transmission lines 
and the effects of such deterioration on the 
logical functioning of the circuits (with the 


223 


implications which can be drawn concerning 
the speed of computation which is safe) are 
not discussed in detail. Indeed, only the most 
idealized engineering realizations of the 
Boolean elements are discussed at all. These 
realizations are limited to vacuum tube cir- 
cuits with no discussion of logical elements 
built of transistors and magnetic cores. Simi- 
larly, the reduction of Boolean expressions to 
most economical form is discussed by impli- 
cation only and no thorough analysis is 
attempted. These omissions are not short- 
comings, for the book is a thorough exposi- 
tion by example of much of the formalism 
which is necessary for an effective applica- 
tion of knowledge in these omitted fields to 
the design of computers. Thus, there is no 
better place for an engineer or other person 
not already well informed concerning sym- 
bolic logic and its application to switching 
circuits to learn how to combine the com- 
ponents which may be developed from new 
electronic devices (such as transistors) into 
effective computing instruments. Similarly, 
there is no other source which seems to give 
as easy access to the ideas involved in 
studies of fast and complex circuitry such 
as, for example, A. Weinberger and J. L. 
Smith, “A One-Microsecond Adder Using 
One-Megacycle Circuitry,” IRE TRAns. 
vol. EC-5, pp. 65-73; 1956. (See 56-178, De- 
cember, 1956.) This article also appears un- 
der the title, “The Logical Design of a One- 
Microsecond Parallel Adder Using One- 
Megacycle Circuitry,” in 1956 Proc. Western 
Joint Computer Conference, San Francisco, 
Calif., sponsored by the AIEE, the Assoc. 
for Computing Machinery, and the IRE. 
Published by the AIEE, New York, pp. 
103-108, 1956.) The author has included a 
chapter on computer organization and con- 
trol and one on programming. These are fair- 
ly superficial accounts suitable for project 
engineers but certainly not sufficiently com- 
plete to serve as serious expositions of these 
complicated subjects. Presumably these 
chapters were added to describe the general 
machine to the engineer working on its 
components. However, the subjects treated 
are not completely within the scope of 
Boolean algebra (as the author notes on p. 
339) and hence not completely within the 
scope of this book. In short, the author has 
prepared a well-directed set of notes for use 
as a practical handbook for anyone inter- 
ested in the inside of an electronic computing 
instrument. The book contains no problems 
for solution by the reader, but otherwise it is 
entirely suitable for use as a textbook for a 
course covered by the material accorded 
attention. The table of contents follows: 
Chapter 1) “Symbolic Representation of 
Quantities,” 2) “Boolean Algebra, Applied 
to Computer Components,” 3) “Switching 
Networks,” 4) “Binary Addition and Sub- 
traction,” 5) “Binary Multiplication and 
Division,” 6) “Decimal Codes,” 7) “Counting, 
Binary and Decimal,” 8) “Decimal Addition 
and Subtraction,” 9) “Decimal Multiplica- 
tion and Division,” 10) “Miscellaneous 
Operations,” 11) “Computer Organization 
and Control,” 12) “Programming, Bibliogra- 
phy, and Index.” 
C. B. Tompkins 
Courtesy of Mathematical Tables 
and other Aids to Computation 
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57-153 


Analog Computer Techniques—Clarence 
L. Johnson. (McGraw-Hill Book Co., Inc., 
New York, N. Y., 280 pp.; 1956.) This book 
was written as a textbook for a course in the 
operation of an electronic differential 
analyzer. Thus, its objectives are highly 
specialized; it does not treat network ana- 
lyzers, electromechanical differential ana- 
lyzers, or any of the other analog computers. 
Furthermore, the author is interested in 
techniques of using analog computers, and 
only passingly in techniques of building such 
computers; in particular, he limits his dis- 
cussion of engineering to the information 
which he feels is essential in proper applica- 
tion of the computer. In this application, 
however, he is insistent that the operator 
“feel” the way in which the machine actually 
functions analogously to the operation being 
simulated. Thus, he would like to have the 
operator understand why a differential 
equation describes a system being studied 
and why the same differential equation de- 
scribes the operation of the analog computer 
used to find a solution. By bypassing the 
differential equation, then, the operator 
understands how the analog computer simu- 
lates the system to be studied. In order to 
get on with his task, the author limits him- 
self bibliographically to those works which 
are of almost immediate importance. It is 
somewhat shocking to find a book on analog 
computation in whose index the name of 
V. Bush appears only once. The Massa- 
chusetts Institute of Technology is likewise 
listed only once, and the name of S. H. 
Caldwell is not in the index. Thus, explicit 
reference to the great pre-war development 
of differential analyzer techniques at M. I.T. 
is almost completely lacking. However, the 
reviewer can see no real necessity for recall- 
ing old times in a strictly utilitarian text- 
book; the bibliographical omissions were 
mentioned above to illustrate the utilitarian 
character of the book and not to criticize the 
author’s scholarship. The one departure from 
the restrictions to electronic differential 
analyzers occurs in the last chapter when 
incremental digital computers are discussed 
(the so-called digital integrating differential 
analyzers). The thought here is that their 
use is more similar to that of the electronic 
differential analyzers than to that of the 
other digital machines. The material in the 
text is presented in a lucid and elementary 
way. It is accompanied by problems for the 
student and numerous illustrations. Each 
chapter has a selected list of references, 
short but seemingly adequate for the mate- 
rial involved. The reviewer feels that the 
book well attains its fundamental purpose 
of presenting the material that must be 
known to a person who intends to operate a 
standard electronic differential analyzer ef- 
fectively. The table of contents is: Chapter 1) 
“Introduction,” 2) “The Linear Computer 
Components,” 3) “Time- and Amplitude- 
Scale Factors,” 4) “The Synthesis of Servo- 
mechanism Systems,” 5) “Multiplying and 
Resolving Servos,” 6) “Additional Computer 
Techniques,” 7) “The Representation of 
Nonlinear Phenomena,” 8) “Multipliers and 
Function Generators,” 9) “Miscellaneous 
Applications of the Electric Analog Com- 
puter,” 10) “Analog Computer Components 
and Computer Control,” 11) “The Checking 
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of Computer Results,” 12) “Repetitive 

Analog Computers,” 13) “The Digital Inte- 
grating Differential Analyzer.” 

C. B. Tompkins 

Courtesy of Mathematical Tables 

and other Aids to Computation 


i 57-154 
Séetno-ReSayuscie Ustrolstva (Com- 
puting Devices)—S. O. DobrogurskiY and 
V. K. Titov. (Gosudarstv. Izdat. Oboronnoi 
Promyslennosti, Moscow, 224 pp.; 1953.) 
Some mechanical, electromechanical and 
electronic analog-computer elements are 
described. Included are most of the well- 
known standard forms: integrators, multi- 
pliers, resolvers, adders, etc. Assembly 
drawings of some of the elements are shown. 
On occasion the author dwells on such 
structural details as mechanical fasteners 
(bolts, taper pins, keys, couplings), stop 
mechanisms, anti-backlash, and wear-com- 
pensating devices. Sources of error in various 
computer elements are pointed out. In a few 
cases detailed error analyses are made. 
Typical are the discussions of statistical 
variation in hole and shaft diameters in 
manufacturing a third-class fit, derivation 
of formulas for mean-square deviation, and 
analysis of potentiometer errors. 
W. W. Soroka 
Courtesy of Mathematical Reviews 


57-155 

Random Processes in Automatic Control 
—J. Halcombe Laning, Jr. and Richard 
H. Battin. (McGraw-Hill Book Co., Inc., 
New York, N. Y., ix+434 pp.; 1956.) This 
book is a presentation of the techniques use- 
ful in analyzing and synthesizing control sys- 
tems whose inputs are random functions of 
time. It contains sufficient background in 
statistical methods to allow the control sys- 
tems engineer, starting with only a speaking 
acquaintance with statistics, to acquire a 
working knowledge of these methods. The 
general aim of the book is to give the engi- 
neer the tools to enable him to fashion some 
sort of figure of merit for a control system 
subject to random inputs. Two preliminary 
chapters devoted to an exposition of “Basic 
Concepts of Probability Theory” and “De- 
scriptions of Random Processes” prepare 
the student (or engineer) for the analyses of 
actual systems. The properties of correlation 
functions, stationary and ergodic processes, 
and the energy spectral density are all 
treated. These chapters are interlarded 
with enough specific examples, illustrative 
of the ideas presented in the text, that the 
reader can gain some facility in giving ana- 
lytic expression to physical statistical prob- 
lems. These preliminary chapters are suffi- 
ciently comprehensive that the reader need 
not, in the subsequent discussions, be limited 
by only an intuitive grasp of probability 
and random processes. On the other hand, 
a complete assimilation of this background 
material is not required in order to make use 
of the techniques presented in the principal 
chapters concerned with systems engineer- 
ing. In these subsequent chapters the exten- 
sive use of the mean-squared error as a per- 
formance index and its limitations are dis- 
cussed candidly. In fact, the careful delinea- 
tion of the state of the techniques discussed 
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is one of the principal features of the book. 
For those areas for which inadequate ana- 
lytical theory exists, the situation is out- 
lined and the analog computation methods, 
which take the place of the undeveloped 
mathematical theory, are explained. Since 
this is the situation for systems with vari- 
able coefficients, or with nonstationary in- 
puts, these analog computing methods are 
finding much use in analyzing actual control 
system problems such as occur in fire control 
system design. The time-saving method of 
adjoint simulation for obtaining mean- 
squared errors is spelled out in some detail. 
For systems with stationary inputs and 
constant coefficient control systems, mathe- 
matical means are developed for obtaining 
the mean-squared error in terms of the 
system weighting function, or transfer func- 
tion, and the input spectral density. The 
final two chapters in the book deal with 
system synthesis rather than analysis. The 
Wiener theory for synthesizing the optimum 
system weighting function is developed. In 
the last chapter it is extended to cases for 
which the input signal is not stationary, and 
for which the past history is known over 
only a limited time. A well annotated bibliog- 
raphy is provided, and a short but complete 
explanation of the analog computer is given 
in an appendix. For either the student or 
the practising control systems engineer, this 
book offers an understandable statement of 
the current techniques (and their limitations) 
available for the analysis and synthesis of 
control systems subject to random input 
signals, 
W. F. Cartwright 
Courtesy of 
The American Mathematical Monthly 


57-156 

Introduction to Numerical Analysis— 

F. B. Hildebrand. (McGraw-Hill Book Co., 
Inc., New York, N. Y., x +511 pp.; 1956.) 
In the preface, the author states that the 
book is intended to provide an introductory 
treatment of the fundamental processes of 
numerical analysis which is compatible with 
the expansion of the field brought about by 
the development of high-speed computing 
machines. However, he indicates that he 
intends to take into account the fact that 
very large amounts of computation will 
continue to be effected by desk calculators 
(and by hand or slide rule) and that familiar- 
ity with computation on a desk calculator 
is a desirable preliminary to computation 
on a high-speed computer. He expects that 
it would be possible to provide a survey of a 
substantial portion of the text in a single 
semester, and that a more thorough coverage 
could be provided in two semesters. It is 
evident that the book will be much more 
valuable to the user of desk computers than 
to the user of high-speed computers. A bet- 
ter background for the field of modern 
computation would be provided by a book 
which covered only the most frequently 
used methods of hand computation and 
which at the same time was written from 
the standpoint of high-speed computing. 
Until such a book appears, however, the 
present volume will probably find extensive 
use as a text for courses in numerical analy- 
sis. It is very clearly written in sufficient 
detail so that a good student should be able 
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to learn the material with little or no assist- 
ance. At the end of each chapter a large 
number of illustrative numerical problems 
are given. These should be of immense value 
to the instructor, since one of the drawbacks 
of other available texts in numerical analysis 
has been the lack of enough good problems. 
The introductory chapter contains a dis- 
cussion of various types of errors, including 
statistical errors, and analyzes the growth 
of such errors. Some mathematical prelimi- 
naries are also provided. The next four 
chapters, covering 140 pages, contain a 
thorough discussion of interpolation, numeri- 
cal quadrature, and numerical differentia- 
tion. Use is made of divided differences, 
methods based on Lagrange’s interpolation 
formula, finite differences, and difference 
operators. The next chapter contains a de- 
scription of the standard methods for solv- 
ing ordinary differential equations together 
with an analysis of so-called “parasitic” 
solutions and of propagated errors. One 
section is devoted to two-point boundary 
value problems and another section describes 
methods for solving characteristic value 
problems. Chapter VII deals with least 
squares polynomial approximation with 
special reference to Legendre, Laguerre, 
Hermite, and Tchebycheff approximations. 
Factorial power functions and summation 
formulas are also discussed. The chapter 
is concluded by a description of several 
techniques for smoothing empirical data. 
Chapter VIII treats Gaussian quadrature 
and other related quadrature methods in- 
cluding Hermite, Legendre-Gauss, Laguerre- 
Gauss, Hermite-Gauss, Tchebycheff-Gauss, 
Jacobi-Gauss, Radan, and Tchebycheff 
quadrature. Chapter IX considers approxi- 
mations of various types including Fourier 
approximation for both continuous and dis- 
crete ranges, exponential approximation, 
Tchebycheff interpolation, and approxima- 
tion by continued fractions. The concluding 
chapter, which is practically independent of 
the preceding chapters, summarizes a num- 
ber of methods for the numerical solution of 
sets of linear algebraic equations, nonlinear 
algebraic or transcendental equations, and 
nonlinear algebraic equations in particular. 
There is a bibliography with 276 references 
and an appendix with a directory of methods. 
In general, it seems that too many methods 
are covered and that there is not enough 
discrimination nor enough discussion of the 
relative merits of the various methods. In 
particular, far too much space is devoted to 
interpolation and to finite differences. It 
would certainly seem that a knowledge of 
only a fraction of the methods presented 
would enable one to handle in a satisfac- 
tory way all except the most unusual inter- 
polation problems. Except for the section on 
error formulas, the entire chapter on opera- 
tor methods might well have been eliminated. 
Similarly a large number of methods are 
presented for solving initial value problems 
for ordinary differential equations and yet 
only a single section is devoted to the im- 
portant topic of two-point boundary value 
problems. The treatment of methods for 
solving systems of linear algebraic equations 
could perhaps have been more detailed, if the 
length of some of the earlier chapters on 
interpolation had been reduced. The ma- 
terial in Chapters VII, VIII, and IX on 
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least squares polynomial approximation, 
Gaussian quadrature, and approximations, 
respectively, is very well presented, and 
does not appear to be readily accessible in as 
palatable a form elsewhere. By concentrat- 
ing only on those methods which are most 
useful for actual computation, an instructor 
should be able to present a very satisfactory 
one-semester course in numerical analysis 
using this book, which is probably the best 
textbook available today for an elementary 
course in numerical analysis. The book 
should be part of the personal library of 
anyone working in the computing field. 
David Young 
Courtesy of 
The American Mathematical Monthly 


57-157 

Numerical Analysis—Z. Kopal. (John 
Wiley and Sons Inc., New York, N. Y., 
xiv-+556 pp.; 1955.) This book is intended to 
be a research handbook as well as a text in 
numerical analysis as applied to functions of 
a single real variable. Although elementary 
calculus and “some algebra” are stated to 
be the only really necessary prerequisites; 
nevertheless, it would appear that consider- 
ably more mathematical background would 
be needed in order to understand some of 
the more advanced chapters. The book will 
probably find wider use as a research hand- 
book than as a text for a course in numerical 
analysis. It would only be possible to cover a 
fraction of the material in a single semester, 
and in a two-semester course in numerical 
analysis, one would almost certainly wish to 
include a considerable number of topics 
which are not treated in the book such as 
algebraic and transcendental equations in- 
volving a single variable, systems of equa- 
tions, matrix problems, and partial differen- 
tial equations. The book is written from a 
point of view considerably removed from 
that of the user of high-speed computing 
machines and lying somewhere between ap- 
plied mathematics and hand computation. 
Some material is included which appears to 
fall in the area of classical analysis rather 
than numerical analysis. For instance, four 
pages are devoted to the standard proof of 
the Picard iteration process for solving ordi- 
nary differential equations and ten pages 
are used to treat the method of Frobenius. 
Since these topics are not treated specifically 
from the point of view of numerical compu- 
tation, it would seem that only the results 
could be given, together with a reference to 
a book on ordinary differential equations. 
The introductory chapter provides an inter- 
esting history of number systems and of 
numerical analysis as well as motivations 
for the study of the subject. Chapter IT con- 
tains descriptions of the usual methods of 
polynomial interpolation, including the 
“throwback” method of Cromie which uses 
modified differences and describes an inter- 
esting application to curve fitting. The next 
chapter contains descriptions of the stand- 
ard methods for solving ordinary differential 
equations. In addition, some new material 
on “successive extrapolation” is developed 
and applied to equations of the form 
yy’ +f(x0)y =2(x). The use of adjoint systems 
to estimate the propagated errors of various 
numerical procedures is also discussed. 
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Chapter V which is entitled “Boundary 
Value Problems” is primarily concerned with 
characteristic value problems associated 
with linear ordinary differential equations. 
By the use of finite difference methods the 
problem is reduced to that of finding the 
characteristic values of a matrix. The use 
of higher order difference equations and 
also various “extrapolations to zero grid 
size” are also considered. Chapter VI treats 
these problems by variational methods in- 
cluding the Rayleigh-Ritz method, Schwarz’s 
method, a “collocation” method which is 
related to Lagrange’s method of interpola- 
tion, and a least squares method. Chapter 
VII deals with a number of methods for 
performing numerical quadrature. Methods 
which use unequally spaced intervals as 
well as those using equally spaced intervals 
are discussed. The concluding chapter deals 
with integral equations and integro-differ- 
ential equations. The following subjects are 
treated in the five appendices: operational 
approach to finite difference formulas; trigo- 
nometric intepolation and Tchebycheff 
polynomials; coefficients for “mechanical” 
quadrature formulas; and algebraic equa- 
tions and systems of linear equations. In 
general, there seems to be too much atten- 
tion devoted to some of the topics with the 
result that the scope is much narrower than 
one would expect from a book of this length. 
The book is very clearly written in a pleasing 
style and the arguments are easy to follow. 
The chapters on variational methods for 
solving characteristic value problems and on 
integral equations are particularly interest- 
ing. At the end of each chapter a fair num- 
ber of examples are provided together with 
supplementary notes and some research 
problems. The book is not entirely devoid 
of misprints; for instance on page 20, line 
27, Q1, @2,°**, An, should be ao, a1, @2,° °°, 
@, and on page 21 formula (II-B-4) should 
have p,/(a;) in the denominator. Although 
this book is not recommended as a text to be 
used in a course in numerical analysis, it 
contains a great deal of interesting material 
and should prove very useful to those who 
work in the field of numerical analysis. 
David Young 
Courtesy of 
The American Mathematical Monthly 


57-158 

An Introduction to Junction Transistor 
Theory—R. D. Middlebrook. (John Wiley 
and Sons, Inc., New York, N. Y., xxiv+295 
pp.; 1957.) The author succeeded in filling 
a gap in the transistor literature by creating 
a book for electronic engineers who are inter- 
ested in the physical aspects of transistor 
operation. It forms a bridge between the 
physics of semiconductors and the circuit 
properties of junction transistors. This book 
provides a continuous development of basic 
junction transistor theory, starting with a 
thorough qualitative analysis of the most 
important fundamental physical principles 
and ending with the derivation of a new 
high-frequency equivalent circuit. The 
standard knowledge of mathematics, phys- 
ics, and electronics of an electronics engineer 
is sufficient for understanding this book. 
The main chapters of the book deal with: 
qualitative development of junction transis- 
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tor theory; qualitative and quantitative 
semiconductor physics; current flow in semi- 
conductors; boundary values for forward 
biased p-n junctions (energy diagram, car- 
rier distribution, etc.); p-2 junctions under 
applied dc potential; p-n-p transistors (inter- 
nal capacitance and feedback effects) ; small- 
signal ac equivalent circuits (complete and 
simplified configuration for circuit appli- 
cations). The qualitative explanations are 
very clear and easy to read. The quantita- 
tive analysis is straightforward and the 
mathematical formulas are carefully derived 
and discussed. Repetitions on purpose are 
helpful in learning the rather complicated 
principles of transistor action. Many figures 
clarify the physical meaning of mathe- 
matical derivations. A new high-frequency 
equivalent circuit, derived from the physics 
of the transistor and proven experimentally 
up to about twice the cutoff frequency, is 
a major contribution. Only the classical 
references are mentioned in each chapter. 
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It is felt that more experimental results 
should have been given to provide a com- 
parison with the calculations. The very 
important topics of high injection and sur- 
face effects are treated rather briefly. Also, 
the drift transistor is not mentioned, but the 
modest title of the book “An Introduction 
to...” tells the reader that this book does 
not intend to be a sort of a “handbook on 
transistor theory.” A discussion of many of 
the formulas with respect to silicon devices 
(not just germanium ones) would have been 
desirable. This book is well written and the 
transistor theory discussed in a surprisingly 
clear, logical, and concrete manner. The 
electronics engineer and the student who 
is not satisfied with transistor knowledge 
from the “black box” point of view will gain 
a thorough understanding of basic transistor 
problems (the “hows” and “whys”) by 
studying the pages of this book. 
Peter Kaufmann 
Courtesy of Proc. IRE 
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Electronic Analog Computers, Second 
Edition—Granino A. Korn and Theresa M. 
Korn. (McGraw-Hill Book Co., New York, 
N. Y., xiv+452 pp.; 1956.) The second 
edition of this book covers the same range of 
material as the first edition. (See 53-47, 
September, 1953.) The various chapters have 
been expanded and brought up to date. In 
particular, there are more examples, and 
more attention is paid to nonlinear situa- 
tions and their representation by diode cir- 
cuits. The reference quality of the book has 
been improved by the addition of Tables of 
Transfer Impedances for Operational Ampli- 
fiers. A table giving circuits for the genera- 
tion of functions of time as solutions of differ- 
ential equations, and a table of potentiome- 
ter circuits of function generation are also 
given. For those interested in analog com- 
putation and analog computers this book is 


a necessity. 
H. D. Huskey 


